[ 508.472233] env[62815]: INFO neutron.common.config [-] Logging enabled! [ 508.472696] env[62815]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 508.472811] env[62815]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62815) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 508.473103] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 508.473267] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 508.474102] env[62815]: WARNING oslo_policy.policy [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 508.474365] env[62815]: WARNING oslo_policy.policy [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 508.475990] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] VMware NSXv3 Agent initialized successfully. [ 508.476369] env[62815]: DEBUG oslo_concurrency.lockutils [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] Acquiring lock "singleton_lock" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 508.476510] env[62815]: DEBUG oslo_concurrency.lockutils [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] Acquired lock "singleton_lock" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 508.476718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] Releasing lock "singleton_lock" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 508.477026] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] Full set of CONF: {{(pid=62815) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 508.477153] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ******************************************************************************** {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 508.477325] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] Configuration options gathered from: {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 508.477677] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 508.477862] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 508.477981] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ================================================================================ {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 508.478174] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] agent_down_time = 75 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.478336] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] allow_automatic_dhcp_failover = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.478474] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] allow_bulk = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.478625] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] api_extensions_path = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.478772] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] api_paste_config = api-paste.ini {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.478921] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] auth_strategy = keystone {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479044] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] backdoor_port = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479159] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] backdoor_socket = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479305] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] backlog = 4096 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479454] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] base_mac = fa:16:3e:00:00:00 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479633] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] bind_host = 0.0.0.0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479800] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] bind_port = 9696 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.479947] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] client_socket_timeout = 900 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.480108] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] config_dir = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.480226] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.480377] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] config_source = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.480529] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] control_exchange = neutron {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.480682] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] core_plugin = ml2 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.480826] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] debug = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.481053] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] default_availability_zones = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.481284] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.481437] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] dhcp_agent_notification = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.481582] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] dhcp_agents_per_network = 1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.481724] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] dhcp_lease_duration = 86400 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.481880] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] dhcp_load_type = networks {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482040] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] dns_domain = openstacklocal {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482195] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482340] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_default_route_bfd = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482483] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_default_route_ecmp = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482636] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_dvr = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482767] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_new_agents = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.482908] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483060] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_signals = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483203] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] enable_traditional_dhcp = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483352] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] external_dns_driver = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483473] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] filter_validation = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483623] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] global_physnet_mtu = 8950 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483765] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] graceful_shutdown_timeout = 60 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.483952] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] host = cpu-1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484140] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] host_dvr_for_dhcp = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484257] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] http_retries = 3 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484410] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] instance_format = [instance: %(uuid)s] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484564] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484710] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ipam_driver = internal {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484852] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ipv6_pd_enabled = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.484993] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] l3_ha = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.485158] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.485434] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] l3_ha_network_physical_name = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.485623] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] l3_ha_network_type = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.485885] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_color = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.486157] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_config_append = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.486426] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.486761] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_dir = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.487032] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_file = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.487247] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_options = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.487613] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_rotate_interval = 1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.487916] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_rotate_interval_type = days {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.488204] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] log_rotation_type = none {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.488418] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.488621] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.488886] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.489162] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.489370] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.489631] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] max_dns_nameservers = 5 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.489951] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] max_header_line = 16384 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.490245] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] max_l3_agents_per_router = 3 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.490499] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] max_logfile_count = 30 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.490751] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] max_logfile_size_mb = 200 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491013] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] max_subnet_host_routes = 20 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491205] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] my_ip = 10.180.1.21 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491365] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] my_ipv6 = ::1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491515] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] network_auto_schedule = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491661] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] network_link_prefix = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491814] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.491964] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] notify_nova_on_port_data_changes = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.492126] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] notify_nova_on_port_status_changes = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.492277] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] pagination_max_limit = -1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.492420] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] publish_errors = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.492566] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] rate_limit_burst = 0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.492717] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] rate_limit_except_level = CRITICAL {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.492861] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] rate_limit_interval = 0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.493138] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] retry_until_window = 30 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.493229] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] router_distributed = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.493360] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] rpc_resources_processing_step = 20 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.493509] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] rpc_response_max_timeout = 600 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.493654] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] rpc_response_timeout = 60 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.493874] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] send_events_interval = 2 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494070] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] service_plugins = ['router'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494253] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] setproctitle = on {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494372] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] shell_completion = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494523] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] state_path = /opt/stack/data/neutron {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494672] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] syslog_log_facility = LOG_USER {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494818] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] tcp_keepidle = 600 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.494962] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] transport_url = **** {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.495119] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] use_journal = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.495292] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] use_json = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.495445] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] use_ssl = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.495594] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] use_stderr = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.495770] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] use_syslog = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.495885] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] vlan_qinq = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496040] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] vlan_transparent = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496186] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] watch_log_file = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496376] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] wsgi_default_pool_size = 100 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496465] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] wsgi_keep_alive = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496615] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496759] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] wsgi_server_debug = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 508.496918] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_concurrency.disable_process_locking = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.497086] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.497246] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.497413] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.497571] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.497725] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.497873] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498046] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.connection_string = messaging:// {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498203] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.enabled = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498360] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.es_doc_type = notification {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498508] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.es_scroll_size = 10000 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498662] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.es_scroll_time = 2m {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498809] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.filter_error_trace = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.498959] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.hmac_keys = **** {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.499153] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.sentinel_service_name = mymaster {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.499275] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.socket_timeout = 0.1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.499471] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.trace_requests = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.499575] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler.trace_sqlalchemy = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.499738] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler_jaeger.process_tags = {} {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.499874] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler_jaeger.service_name_prefix = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.500030] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] profiler_otlp.service_name_prefix = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.500192] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.enforce_new_defaults = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.500466] env[62815]: WARNING oslo_config.cfg [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 508.500629] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.enforce_scope = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.500783] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.policy_default_rule = default {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.500942] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501106] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501264] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501409] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501555] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501695] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501840] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.501992] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.502165] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.502324] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] agent.extensions = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.502477] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.502628] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] service_providers.service_provider = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.502783] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.default_quota = -1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.502938] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503093] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_floatingip = 50 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503241] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_network = 100 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503387] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_port = 500 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503537] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503678] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_router = 10 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503821] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_security_group = 10 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.503968] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504118] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.quota_subnet = 100 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504261] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] QUOTAS.track_quota_usage = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504421] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504561] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep.group = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504706] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep.helper_command = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504852] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.504997] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep.thread_pool_size = 8 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.505158] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep.user = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.505882] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.505882] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_dhcp_release.group = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.505882] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_dhcp_release.helper_command = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.505882] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.505882] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506084] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_dhcp_release.user = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506184] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506368] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_ovs_vsctl.group = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506473] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_ovs_vsctl.helper_command = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506612] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506759] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.506902] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_ovs_vsctl.user = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507065] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_namespace.capabilities = [21] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507201] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_namespace.group = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507355] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_namespace.helper_command = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507519] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507669] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_namespace.thread_pool_size = 8 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507812] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_namespace.user = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.507966] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_conntrack.capabilities = [12] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508119] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_conntrack.group = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508259] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_conntrack.helper_command = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508405] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508552] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508701] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_conntrack.user = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508834] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_link.capabilities = [12, 21] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.508971] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_link.group = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.509121] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_link.helper_command = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.509268] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.509412] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_link.thread_pool_size = 8 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.509554] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] privsep_link.user = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.509717] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.509873] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510031] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.continue_on_failed_promotions = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510178] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.dscp = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510324] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.dscp_inherit = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510476] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.force_mp_to_policy = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510619] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.locking_coordinator_url = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510764] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.log_agent_heartbeats = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.510908] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.logging_expire = 1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511072] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511223] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511377] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.polling_interval = 240 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511526] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511676] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511828] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.report_interval = 30.0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.511980] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.512143] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.512295] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.512442] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.sync_skew = 60 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.512591] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.synchronization_queue_size = 20 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.512743] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT.use_helper_for_ns_read = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.512893] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] SECURITYGROUP.enable_ipset = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.513050] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] SECURITYGROUP.enable_security_group = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.513203] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.513477] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.513587] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] experimental.ipv6_pd_enabled = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.513865] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.extension_drivers = ['port_security'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.513865] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.external_network_type = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514081] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514200] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.overlay_ip_version = 4 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514343] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.path_mtu = 8950 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514479] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.physical_network_mtus = {} {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514637] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.tenant_network_types = ['vlan'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514786] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.514940] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ml2.type_drivers = ['vlan'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.515272] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT_CLI.neutron_port_id = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.515272] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.515440] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.515601] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.515754] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.515907] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.516070] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.516226] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.516377] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.516586] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.516744] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_login_password = **** {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.516900] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_login_port = 443 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.517060] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_login_user = admin {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.517215] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.517400] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.517551] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.517698] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.517853] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.518019] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.518171] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.518371] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.518602] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.518711] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519020] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519110] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519234] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519436] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519637] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] vsphere.vsphere_login_password = VMware1! {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519799] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.519950] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.520115] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.auth_section = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.520273] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.auth_type = password {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.520427] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.520573] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.certfile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.520720] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.collect_timing = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.520875] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.endpoint_type = public {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521031] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.insecure = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521176] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.keyfile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521330] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.region_name = RegionOne {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521479] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.split_loggers = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521621] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] nova.timeout = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521769] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.auth_section = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.521923] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.auth_type = password {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522085] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522230] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.certfile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522374] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.collect_timing = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522524] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.endpoint_type = public {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522665] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.insecure = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522801] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.keyfile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.522936] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.region_name = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523086] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.split_loggers = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523227] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] placement.timeout = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523373] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.auth_section = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523517] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.auth_type = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523694] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.cafile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523796] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.certfile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.523940] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.collect_timing = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524086] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.connect_retries = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524226] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.connect_retry_delay = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524370] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.enable_notifications = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524507] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.endpoint_override = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524647] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.insecure = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524784] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.interface = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.524921] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.keyfile = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525069] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.max_version = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525229] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.min_version = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525384] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.region_name = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525528] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.retriable_status_codes = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525667] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.service_name = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525805] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.service_type = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.525950] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.split_loggers = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526101] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.status_code_retries = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526241] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.status_code_retry_delay = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526379] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.timeout = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526521] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.valid_interfaces = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526662] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ironic.version = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526811] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] cli_script.dry_run = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.526964] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.527119] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.527264] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.527432] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.527581] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.527724] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.527866] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528020] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528169] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528341] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528495] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528651] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528800] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.528947] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529111] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529256] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529401] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529555] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529700] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529844] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.529991] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.530178] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.530326] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.530472] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.530617] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.530762] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.530907] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531058] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531207] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531352] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.ssl = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531507] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531658] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531802] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.531952] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532112] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532256] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532411] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_notifications.driver = [] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532557] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_notifications.retry = -1 {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532715] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532859] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 508.532972] env[62815]: DEBUG oslo_service.service [None req-9c2fde8c-7b65-45dc-807f-9b03c0c8bbd7 None None] ******************************************************************************** {{(pid=62815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 508.533996] env[62815]: DEBUG neutron.agent.securitygroups_rpc [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Init firewall settings (driver=nsxv3) {{(pid=62815) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 508.535349] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=62815) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 508.535574] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] RPC agent_id: nsxm-l-01a.corp.local [ 508.537857] env[62815]: DEBUG dogpile.cache.region [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 508.537980] env[62815]: DEBUG dogpile.lock [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 508.538095] env[62815]: DEBUG dogpile.lock [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 508.538195] env[62815]: DEBUG dogpile.lock [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 508.538313] env[62815]: DEBUG dogpile.cache.region [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 508.538424] env[62815]: DEBUG dogpile.lock [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 508.538551] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 508.556127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Session token - acquiring [ 508.558046] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 508.558245] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 508.558319] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 508.558714] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 508.570327] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 508.823311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 508.844204] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 508.844356] env[62815]: DEBUG dogpile.cache.region [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Cache value generated in 0.306 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 508.844466] env[62815]: DEBUG dogpile.lock [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 508.844588] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Activating Policy API Provider. [ 508.844780] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Looking for the default Infrastructure Rules. [ 508.902866] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Looking for the Default Layer3 Logged Drop Section. [ 508.915913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 508.916377] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 508.916548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 508.916656] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 508.916935] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 508.917278] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 509.432117] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 509.936537] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 510.438756] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Inventory metadata is going to be refreshed. [ 510.438903] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 511.295592] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.296118] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.296118] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.296286] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.306975] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 511.307881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.308776] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 511.324413] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.324586] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.324697] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.324951] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.325092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.325242] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 511.325377] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 511.325494] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 511.343180] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.343457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.343457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.343719] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.343890] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.344048] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 511.363137] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.363318] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.363449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.363676] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.363822] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.363964] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 511.381572] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.381831] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.381831] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.382117] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.382259] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.382411] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 511.382675] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 511.382810] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 511.399170] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.399359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.399479] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.399690] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.399824] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.399967] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 511.400082] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 511.400214] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 511.417216] env[62815]: DEBUG networking_nsxv3.common.locking [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 511.417434] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 511.417535] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 511.417781] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 511.417919] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.418079] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 511.418190] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 511.418330] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Inventory metadata have been refreshed. [ 511.418449] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Dryrun:True. Metadata refresh completed. [ 511.418576] env[62815]: DEBUG oslo_concurrency.lockutils [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Releasing lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 511.420246] env[62815]: INFO neutron.agent.agent_extensions_manager [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Loaded agent extensions: [] [ 511.420936] env[62815]: DEBUG neutron_lib.callbacks.manager [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=62815) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 511.471540] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent RPC Daemon Started! [ 511.471702] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:0 started [ 511.471816] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent out of sync with plugin! [ 516.421556] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 516.421983] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 521.423447] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 521.423850] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 525.270210] env[62815]: INFO networking_nsxv3.common.synchronization [None req-7fba9673-6cd3-4815-b2a2-b65eab515192 demo admin] Enqueued Resource ID: 8668b254-f712-4cae-84d1-45bd7add8485 with Priority: HIGHEST for action security_group_rules [ 525.270737] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8668b254-f712-4cae-84d1-45bd7add8485 with Priority: HIGHEST for action security_group_rules [ 525.271054] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8668b254-f712-4cae-84d1-45bd7add8485 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.271181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8668b254-f712-4cae-84d1-45bd7add8485" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 525.271252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8668b254-f712-4cae-84d1-45bd7add8485" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.271598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8668b254-f712-4cae-84d1-45bd7add8485" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 525.271685] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8668b254-f712-4cae-84d1-45bd7add8485',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.792140] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.792361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 525.792427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.792599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 525.792692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 525.792793] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8668b254-f712-4cae-84d1-45bd7add8485 already deleted. [ 525.792873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8668b254-f712-4cae-84d1-45bd7add8485" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 530.272068] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 530.272068] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 535.272812] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.273217] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.274017] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.274407] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.275610] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.275610] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.888317] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e73e06ec-acac-4fd6-b7e5-42b5087661d9 None None] Enqueued Resource ID: 4ff5e090-e35c-458e-a708-21dcfb83d3f7 with Priority: HIGHEST for action port [ 547.888740] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff5e090-e35c-458e-a708-21dcfb83d3f7 with Priority: HIGHEST for action port [ 547.889168] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff5e090-e35c-458e-a708-21dcfb83d3f7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.889292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff5e090-e35c-458e-a708-21dcfb83d3f7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 547.889357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff5e090-e35c-458e-a708-21dcfb83d3f7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.889617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff5e090-e35c-458e-a708-21dcfb83d3f7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 547.889694] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff5e090-e35c-458e-a708-21dcfb83d3f7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.392853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff5e090-e35c-458e-a708-21dcfb83d3f7 [ 548.392853] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.392853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 548.392853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.392853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 548.392853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 548.392853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff5e090-e35c-458e-a708-21dcfb83d3f7 already deleted. [ 548.393190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff5e090-e35c-458e-a708-21dcfb83d3f7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.434948] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e56ceba4-3214-46dd-8499-24cb59144c1a None None] Enqueued Resource ID: 6d6b2ff0-639b-4766-9c9c-71c85e11f6b8 with Priority: HIGHEST for action port [ 549.435228] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d6b2ff0-639b-4766-9c9c-71c85e11f6b8 with Priority: HIGHEST for action port [ 549.435783] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d6b2ff0-639b-4766-9c9c-71c85e11f6b8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.435928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d6b2ff0-639b-4766-9c9c-71c85e11f6b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.436016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d6b2ff0-639b-4766-9c9c-71c85e11f6b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.436265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d6b2ff0-639b-4766-9c9c-71c85e11f6b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.436350] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d6b2ff0-639b-4766-9c9c-71c85e11f6b8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.939994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d6b2ff0-639b-4766-9c9c-71c85e11f6b8 [ 549.939994] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.939994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 549.939994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.939994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 549.939994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 549.939994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d6b2ff0-639b-4766-9c9c-71c85e11f6b8 already deleted. [ 549.939994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d6b2ff0-639b-4766-9c9c-71c85e11f6b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.419601] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d94bdff3-f800-47e2-8868-0f4465f8d727 None None] Enqueued Resource ID: 086cb3a5-6120-4af9-9406-a385f46ce53c with Priority: HIGHEST for action port [ 551.420620] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086cb3a5-6120-4af9-9406-a385f46ce53c with Priority: HIGHEST for action port [ 551.420620] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-086cb3a5-6120-4af9-9406-a385f46ce53c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.420620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-086cb3a5-6120-4af9-9406-a385f46ce53c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.420620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-086cb3a5-6120-4af9-9406-a385f46ce53c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.421547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-086cb3a5-6120-4af9-9406-a385f46ce53c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.421547] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('086cb3a5-6120-4af9-9406-a385f46ce53c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.926158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 086cb3a5-6120-4af9-9406-a385f46ce53c [ 551.926158] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.926158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 551.926158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.926158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 551.926158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 551.926158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:086cb3a5-6120-4af9-9406-a385f46ce53c already deleted. [ 551.926158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-086cb3a5-6120-4af9-9406-a385f46ce53c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 553.649194] env[62815]: INFO networking_nsxv3.common.synchronization [None req-cf29a719-8953-4252-9aac-db3213ebd3f1 None None] Enqueued Resource ID: 0040cd0d-87eb-442e-9747-2f41a4a18a10 with Priority: HIGHEST for action port [ 553.649194] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0040cd0d-87eb-442e-9747-2f41a4a18a10 with Priority: HIGHEST for action port [ 553.649603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0040cd0d-87eb-442e-9747-2f41a4a18a10 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.649722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0040cd0d-87eb-442e-9747-2f41a4a18a10" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.649789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0040cd0d-87eb-442e-9747-2f41a4a18a10" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.650799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0040cd0d-87eb-442e-9747-2f41a4a18a10" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.650912] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0040cd0d-87eb-442e-9747-2f41a4a18a10',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.685988] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e2755cd3-d790-4e46-878f-8d692c19f6d2 None None] Enqueued Resource ID: b489a9a4-22ef-4684-a894-19894c4d085d with Priority: HIGHEST for action port [ 553.686283] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b489a9a4-22ef-4684-a894-19894c4d085d with Priority: HIGHEST for action port [ 553.686803] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b489a9a4-22ef-4684-a894-19894c4d085d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.686922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b489a9a4-22ef-4684-a894-19894c4d085d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 553.687245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b489a9a4-22ef-4684-a894-19894c4d085d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.687537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b489a9a4-22ef-4684-a894-19894c4d085d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 553.687537] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b489a9a4-22ef-4684-a894-19894c4d085d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.158315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0040cd0d-87eb-442e-9747-2f41a4a18a10 [ 554.158315] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.158315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.158315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.158315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.158315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.158315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0040cd0d-87eb-442e-9747-2f41a4a18a10 already deleted. [ 554.158315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0040cd0d-87eb-442e-9747-2f41a4a18a10" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.190200] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b489a9a4-22ef-4684-a894-19894c4d085d [ 554.190444] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.190580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.190653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.191958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.192122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.192229] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b489a9a4-22ef-4684-a894-19894c4d085d already deleted. [ 554.192319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b489a9a4-22ef-4684-a894-19894c4d085d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 554.730321] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a9b2f97b-32f6-4f17-8152-ea1f3392f338 None None] Enqueued Resource ID: 386e12cb-3837-4b69-b29e-ba9235580fb5 with Priority: HIGHEST for action port [ 554.730988] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 386e12cb-3837-4b69-b29e-ba9235580fb5 with Priority: HIGHEST for action port [ 554.732471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-386e12cb-3837-4b69-b29e-ba9235580fb5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.732698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-386e12cb-3837-4b69-b29e-ba9235580fb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 554.732698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-386e12cb-3837-4b69-b29e-ba9235580fb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.732927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-386e12cb-3837-4b69-b29e-ba9235580fb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 554.733026] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('386e12cb-3837-4b69-b29e-ba9235580fb5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.236346] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 386e12cb-3837-4b69-b29e-ba9235580fb5 [ 555.236683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.237156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.237265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.237545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.237671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.237802] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:386e12cb-3837-4b69-b29e-ba9235580fb5 already deleted. [ 555.237921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-386e12cb-3837-4b69-b29e-ba9235580fb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 555.853431] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5389943d-b431-43e1-8e66-f837cff4895f None None] Enqueued Resource ID: b5f1c874-0341-47de-9c4c-0e156bc3aeb0 with Priority: HIGHEST for action port [ 555.854014] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5f1c874-0341-47de-9c4c-0e156bc3aeb0 with Priority: HIGHEST for action port [ 555.854556] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5f1c874-0341-47de-9c4c-0e156bc3aeb0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.855894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5f1c874-0341-47de-9c4c-0e156bc3aeb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.855894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5f1c874-0341-47de-9c4c-0e156bc3aeb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.855894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5f1c874-0341-47de-9c4c-0e156bc3aeb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.855894] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5f1c874-0341-47de-9c4c-0e156bc3aeb0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.957775] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a755a9b1-fecb-444b-81fd-63431f06dd49 None None] Enqueued Resource ID: 567b1bd8-ae68-4211-887f-55d040882ff6 with Priority: HIGHEST for action port [ 555.958078] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 567b1bd8-ae68-4211-887f-55d040882ff6 with Priority: HIGHEST for action port [ 555.958845] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-567b1bd8-ae68-4211-887f-55d040882ff6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.959225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-567b1bd8-ae68-4211-887f-55d040882ff6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 555.960358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-567b1bd8-ae68-4211-887f-55d040882ff6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.960814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-567b1bd8-ae68-4211-887f-55d040882ff6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 555.960814] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567b1bd8-ae68-4211-887f-55d040882ff6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.358299] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5f1c874-0341-47de-9c4c-0e156bc3aeb0 [ 556.364148] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.364148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.364148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.364148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.364148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.364148] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5f1c874-0341-47de-9c4c-0e156bc3aeb0 already deleted. [ 556.364148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5f1c874-0341-47de-9c4c-0e156bc3aeb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.463597] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 567b1bd8-ae68-4211-887f-55d040882ff6 [ 556.463922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.464080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.464154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.464362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.464455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.464549] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:567b1bd8-ae68-4211-887f-55d040882ff6 already deleted. [ 556.464656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-567b1bd8-ae68-4211-887f-55d040882ff6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 556.727771] env[62815]: INFO networking_nsxv3.common.synchronization [None req-82d2430f-99a4-42da-bc11-68b32c8a654f None None] Enqueued Resource ID: 72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc with Priority: HIGHEST for action port [ 556.728543] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc with Priority: HIGHEST for action port [ 556.728817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.728946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 556.729125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.729901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 556.729901] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.233562] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc [ 557.234068] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.234222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 557.234294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.234499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 557.234591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 557.234685] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc already deleted. [ 557.234765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72aa6a4b-fdf9-46e4-92d1-dd2c409ce4fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.016416] env[62815]: INFO networking_nsxv3.common.synchronization [None req-bde57ea9-d40e-4b54-af64-e54d006ed4ec None None] Enqueued Resource ID: 81274514-0cb9-4a55-8b90-fbfbce0b8df0 with Priority: HIGHEST for action port [ 558.016688] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81274514-0cb9-4a55-8b90-fbfbce0b8df0 with Priority: HIGHEST for action port [ 558.017259] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-81274514-0cb9-4a55-8b90-fbfbce0b8df0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.017388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81274514-0cb9-4a55-8b90-fbfbce0b8df0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.017460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81274514-0cb9-4a55-8b90-fbfbce0b8df0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.017712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81274514-0cb9-4a55-8b90-fbfbce0b8df0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.017796] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81274514-0cb9-4a55-8b90-fbfbce0b8df0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.324597] env[62815]: INFO networking_nsxv3.common.synchronization [None req-4f472cc1-6f33-4d63-840b-b7d6beff924c tempest-ServersTestJSON-2023342580 tempest-ServersTestJSON-2023342580-project-member] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_rules [ 558.325288] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_rules [ 558.327221] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.327536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.327536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.328169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.328333] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.400895] env[62815]: INFO networking_nsxv3.common.synchronization [None req-959d8c5a-d587-4cb7-8b18-e9eb2763c3df tempest-ServersTestJSON-2023342580 tempest-ServersTestJSON-2023342580-project-member] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_rules [ 558.401906] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_rules [ 558.401906] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.401906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.521862] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81274514-0cb9-4a55-8b90-fbfbce0b8df0 [ 558.521862] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.521862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.521862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.521862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.521862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.521862] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81274514-0cb9-4a55-8b90-fbfbce0b8df0 already deleted. [ 558.521862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81274514-0cb9-4a55-8b90-fbfbce0b8df0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.850333] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.850493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.850566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.850786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.850880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.850974] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 already deleted. [ 558.851078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 558.851219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.851373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.851459] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.942350] env[62815]: INFO networking_nsxv3.common.synchronization [None req-0c0c01b2-c7d1-4de1-b12f-0300bb14ebb0 None None] Enqueued Resource ID: 93d3e9ab-0c09-40ba-91e2-f1c78e2d1618 with Priority: HIGHEST for action port [ 558.943416] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d3e9ab-0c09-40ba-91e2-f1c78e2d1618 with Priority: HIGHEST for action port [ 558.943697] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-93d3e9ab-0c09-40ba-91e2-f1c78e2d1618 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.943817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93d3e9ab-0c09-40ba-91e2-f1c78e2d1618" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 558.943918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93d3e9ab-0c09-40ba-91e2-f1c78e2d1618" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.944144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93d3e9ab-0c09-40ba-91e2-f1c78e2d1618" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 558.944224] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93d3e9ab-0c09-40ba-91e2-f1c78e2d1618',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.371857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.371857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.371857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.371857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.371857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.371857] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 already deleted. [ 559.371857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.445892] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93d3e9ab-0c09-40ba-91e2-f1c78e2d1618 [ 559.446295] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.446391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 559.446438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.446640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 559.446728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 559.447184] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93d3e9ab-0c09-40ba-91e2-f1c78e2d1618 already deleted. [ 559.447184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93d3e9ab-0c09-40ba-91e2-f1c78e2d1618" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 560.772374] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2918d0cc-eb80-4108-97b9-46622c7b3fb5 None None] Enqueued Resource ID: 995c1992-70d1-4fb3-8b01-31e598a88d66 with Priority: HIGHEST for action port [ 560.772374] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 995c1992-70d1-4fb3-8b01-31e598a88d66 with Priority: HIGHEST for action port [ 560.772374] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-995c1992-70d1-4fb3-8b01-31e598a88d66 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.772374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-995c1992-70d1-4fb3-8b01-31e598a88d66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 560.772374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-995c1992-70d1-4fb3-8b01-31e598a88d66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.773047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-995c1992-70d1-4fb3-8b01-31e598a88d66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 560.773224] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995c1992-70d1-4fb3-8b01-31e598a88d66',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.276598] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 995c1992-70d1-4fb3-8b01-31e598a88d66 [ 561.277058] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.277546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.277705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.278047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.278286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.278736] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:995c1992-70d1-4fb3-8b01-31e598a88d66 already deleted. [ 561.278923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-995c1992-70d1-4fb3-8b01-31e598a88d66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.318970] env[62815]: INFO networking_nsxv3.common.synchronization [req-396018bf-e802-46f4-b553-6e00a80fdfa7 req-8ca6ed63-e071-4377-aa91-57e31fca5d3b tempest-MigrationsAdminTest-121633230 tempest-MigrationsAdminTest-121633230-project-member] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 561.320702] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 561.320702] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.320702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.320702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.320856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.321207] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.321342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.321433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.321622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.321743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.322281] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.424145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.425692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.425692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.425692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.425692] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.825905] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.825905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.825905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.825905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.825905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.825905] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.825905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.825905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.826468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.828216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.828216] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 already deleted. [ 561.828216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 561.882090] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d4c5282b-9531-498e-9dff-3aac0f2da685 None None] Enqueued Resource ID: 43ad1537-91e4-480a-9a2e-c4ba5b797fdb with Priority: HIGHEST for action port [ 561.882090] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ad1537-91e4-480a-9a2e-c4ba5b797fdb with Priority: HIGHEST for action port [ 561.882638] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-43ad1537-91e4-480a-9a2e-c4ba5b797fdb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.882752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43ad1537-91e4-480a-9a2e-c4ba5b797fdb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 561.882868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43ad1537-91e4-480a-9a2e-c4ba5b797fdb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.889271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43ad1537-91e4-480a-9a2e-c4ba5b797fdb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 561.889875] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43ad1537-91e4-480a-9a2e-c4ba5b797fdb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.931479] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.391696] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43ad1537-91e4-480a-9a2e-c4ba5b797fdb [ 562.392543] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.393678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.393792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.394205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.394546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.395070] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43ad1537-91e4-480a-9a2e-c4ba5b797fdb already deleted. [ 562.395144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43ad1537-91e4-480a-9a2e-c4ba5b797fdb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.408870] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9131b5b7-7140-4f48-8be1-198cda4aaf8c None None] Enqueued Resource ID: 75cb3575-f3bf-4fd9-9635-690fd877c55f with Priority: HIGHEST for action port [ 562.409169] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cb3575-f3bf-4fd9-9635-690fd877c55f with Priority: HIGHEST for action port [ 562.409734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-75cb3575-f3bf-4fd9-9635-690fd877c55f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.409891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75cb3575-f3bf-4fd9-9635-690fd877c55f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.409925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75cb3575-f3bf-4fd9-9635-690fd877c55f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.410173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75cb3575-f3bf-4fd9-9635-690fd877c55f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.410250] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75cb3575-f3bf-4fd9-9635-690fd877c55f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.435394] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.473658] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.473658] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.473658] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.473808] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.476530] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.476725] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.476848] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.477141] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.477355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.477583] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 562.477700] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 562.477813] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 562.477920] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 562.478043] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 562.478223] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 562.478365] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 562.502147] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 562.502888] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 562.504519] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 562.504825] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.505183] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.505362] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.505488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.505889] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.507657] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad3cf823-5152-4b0e-9f6d-f6cb9e667c44',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.913548] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75cb3575-f3bf-4fd9-9635-690fd877c55f [ 562.913784] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.913917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 562.913985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.914455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 562.914562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.914663] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75cb3575-f3bf-4fd9-9635-690fd877c55f already deleted. [ 562.914743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75cb3575-f3bf-4fd9-9635-690fd877c55f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 562.937371] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 562.937484] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 563.011596] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.011851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.011999] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.012518] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.012518] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.012693] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 not found, creating... [ 563.013000] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.013191] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.013340] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.013594] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.013744] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.018306] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.018529] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.018689] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.018966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.019155] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.019339] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 is going to be created. [ 563.061432] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.061640] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.061766] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.062054] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.062296] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.062521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.343991] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5998c105-96f9-4e8d-b4dc-748dd5f90bfe None None] Enqueued Resource ID: 3aae8018-0171-4428-981f-7fa0b949880d with Priority: HIGHEST for action port [ 563.343991] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aae8018-0171-4428-981f-7fa0b949880d with Priority: HIGHEST for action port [ 563.344248] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aae8018-0171-4428-981f-7fa0b949880d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.344347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aae8018-0171-4428-981f-7fa0b949880d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.344414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aae8018-0171-4428-981f-7fa0b949880d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.344666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aae8018-0171-4428-981f-7fa0b949880d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.344735] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aae8018-0171-4428-981f-7fa0b949880d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.599485] env[62815]: INFO networking_nsxv3.common.synchronization [None req-23587ad6-e606-4629-929e-0dd415b3b910 None None] Enqueued Resource ID: ecdc7218-5e1f-445a-8440-698318a88583 with Priority: HIGHEST for action port [ 563.599757] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdc7218-5e1f-445a-8440-698318a88583 with Priority: HIGHEST for action port [ 563.600361] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecdc7218-5e1f-445a-8440-698318a88583 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.600490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecdc7218-5e1f-445a-8440-698318a88583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.600559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecdc7218-5e1f-445a-8440-698318a88583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.600809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecdc7218-5e1f-445a-8440-698318a88583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.600911] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecdc7218-5e1f-445a-8440-698318a88583',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.849863] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3aae8018-0171-4428-981f-7fa0b949880d [ 563.849863] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.849863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.849863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.849863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.849863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.849863] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3aae8018-0171-4428-981f-7fa0b949880d already deleted. [ 563.849863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aae8018-0171-4428-981f-7fa0b949880d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.898174] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.898174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.898174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.899198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.916734] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 563.918937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.919820] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 563.937724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.937923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.937923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.938170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.938811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.939061] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 563.939151] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 563.939235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 563.961434] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.961588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.961641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.961842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.961970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.962098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 563.988262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.988411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 563.988485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.988696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 563.988803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 563.989010] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 564.016021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.016021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.016021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.016021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.016021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.016021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 564.016021] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.016021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 564.033524] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.033669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.033742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.034390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.034486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.038021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 564.038021] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.038021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 564.061341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.061528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.061575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.061797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.061903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.066052] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 564.066254] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.066929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 564.066929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 564.066929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 564.066929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 564.066929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 564.066929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 564.067165] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 564.070241] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 564.092105] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.092105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.092105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.092105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.092105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.092105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 564.105388] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecdc7218-5e1f-445a-8440-698318a88583 [ 564.105665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.105736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.105803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.106017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.106110] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.106201] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecdc7218-5e1f-445a-8440-698318a88583 already deleted. [ 564.106277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecdc7218-5e1f-445a-8440-698318a88583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.113806] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.113954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.114027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.114214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.114317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.144972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.342749] env[62815]: INFO networking_nsxv3.common.synchronization [req-396018bf-e802-46f4-b553-6e00a80fdfa7 req-05b5476c-3229-4e62-8614-e312ec3f2cd1 service nova] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_rules [ 564.342749] env[62815]: INFO networking_nsxv3.common.synchronization [req-396018bf-e802-46f4-b553-6e00a80fdfa7 req-05b5476c-3229-4e62-8614-e312ec3f2cd1 service nova] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 564.342749] env[62815]: INFO networking_nsxv3.common.synchronization [req-396018bf-e802-46f4-b553-6e00a80fdfa7 req-05b5476c-3229-4e62-8614-e312ec3f2cd1 service nova] Enqueued Resource ID: ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 with Priority: HIGHEST for action port [ 564.342749] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_rules [ 564.342749] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 564.342749] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 with Priority: HIGHEST for action port [ 564.342749] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.342749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.342749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.342749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.342749] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.344064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.344127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.344196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.344378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.344583] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.344682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.344771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.346450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.346543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.346726] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.347844] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.347973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.348037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.348208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.348284] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad3cf823-5152-4b0e-9f6d-f6cb9e667c44',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.475760] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d2f73d48-235d-4b28-89a3-ace49a61b050 None None] Enqueued Resource ID: 56de5aa9-9406-48d5-9763-24a02db23eb1 with Priority: HIGHEST for action port [ 564.476343] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56de5aa9-9406-48d5-9763-24a02db23eb1 with Priority: HIGHEST for action port [ 564.476862] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-56de5aa9-9406-48d5-9763-24a02db23eb1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.476989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56de5aa9-9406-48d5-9763-24a02db23eb1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.481940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56de5aa9-9406-48d5-9763-24a02db23eb1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.481940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56de5aa9-9406-48d5-9763-24a02db23eb1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.481940] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56de5aa9-9406-48d5-9763-24a02db23eb1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.846888] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.847035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.851193] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.870245] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 with status ACTIVE [ 564.870245] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.870428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.870428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.871453] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.871453] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.871453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.872021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.872021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.872021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.872021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad3cf823-5152-4b0e-9f6d-f6cb9e667c44 is going to be updated. [ 564.903577] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.903978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.904078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.904270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.904454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.905047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad3cf823-5152-4b0e-9f6d-f6cb9e667c44" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.986320] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56de5aa9-9406-48d5-9763-24a02db23eb1 [ 564.986320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.986320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 564.986320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.986669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 564.986669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 564.986757] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56de5aa9-9406-48d5-9763-24a02db23eb1 already deleted. [ 564.986757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56de5aa9-9406-48d5-9763-24a02db23eb1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.356827] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.358262] env[62815]: INFO networking_nsxv3.common.synchronization [req-f6b483f3-f88b-4c73-b34a-a82286b4cadf req-bb307727-ca80-425c-8683-2d00a119d6c6 tempest-DeleteServersAdminTestJSON-1887008233 tempest-DeleteServersAdminTestJSON-1887008233-project-member] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 565.363016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 565.364384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.364384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.364384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.364750] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.673676] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.674561] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.675247] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.676203] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.676203] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.676203] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.676388] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.676554] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.676696] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.677163] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 565.677889] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 565.677889] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 565.677889] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 565.678111] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 565.678111] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 565.678270] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 565.704025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 565.705895] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 565.705895] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 565.705895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.705895] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-73683d80-1439-4767-af0d-933fea706711 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.705895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.705895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.707251] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.707251] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73683d80-1439-4767-af0d-933fea706711',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.859774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.859892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.859965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.860204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.860296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.860395] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be created. [ 565.870496] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.870660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.870736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.870954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.871167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.871259] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.871361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.871427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.871580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.871657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.871742] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 already deleted. [ 565.871819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.915778] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.915778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 565.915992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.916593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 565.916593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 565.928158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: UNINITIALIZED for 2s [ 566.210533] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.210847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.213081] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 73683d80-1439-4767-af0d-933fea706711 not found, creating... [ 566.213081] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.213081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.213081] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.213571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.213571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.213571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.213571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.213571] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 73683d80-1439-4767-af0d-933fea706711 is going to be created. [ 566.235739] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.235990] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.236131] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.236424] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.236632] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.236847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 566.561649] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9ad7a1b6-c7a4-4c4c-927c-3db5576a6bd2 None None] Enqueued Resource ID: 4277f991-187f-43d3-aba4-fcb4dcf85c0a with Priority: HIGHEST for action port [ 566.563027] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4277f991-187f-43d3-aba4-fcb4dcf85c0a with Priority: HIGHEST for action port [ 566.564043] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4277f991-187f-43d3-aba4-fcb4dcf85c0a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.564223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4277f991-187f-43d3-aba4-fcb4dcf85c0a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 566.564342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4277f991-187f-43d3-aba4-fcb4dcf85c0a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.564638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4277f991-187f-43d3-aba4-fcb4dcf85c0a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 566.564844] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4277f991-187f-43d3-aba4-fcb4dcf85c0a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.068184] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4277f991-187f-43d3-aba4-fcb4dcf85c0a [ 567.068447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.068591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.068656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.070120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.070120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.070120] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4277f991-187f-43d3-aba4-fcb4dcf85c0a already deleted. [ 567.070120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4277f991-187f-43d3-aba4-fcb4dcf85c0a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.184330] env[62815]: INFO networking_nsxv3.common.synchronization [req-f6b483f3-f88b-4c73-b34a-a82286b4cadf req-c97185d9-c2dc-4b05-8e6c-4c4a0d8caa94 service nova] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_rules [ 567.184330] env[62815]: INFO networking_nsxv3.common.synchronization [req-f6b483f3-f88b-4c73-b34a-a82286b4cadf req-c97185d9-c2dc-4b05-8e6c-4c4a0d8caa94 service nova] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 567.184330] env[62815]: INFO networking_nsxv3.common.synchronization [req-f6b483f3-f88b-4c73-b34a-a82286b4cadf req-c97185d9-c2dc-4b05-8e6c-4c4a0d8caa94 service nova] Enqueued Resource ID: 73683d80-1439-4767-af0d-933fea706711 with Priority: HIGHEST for action port [ 567.184438] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_rules [ 567.185431] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 567.185431] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73683d80-1439-4767-af0d-933fea706711 with Priority: HIGHEST for action port [ 567.185431] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.185431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.185431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.185948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.185948] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.188967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.189844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.189844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.189844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.189844] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.190498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.190498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.190498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.190926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.190926] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.191441] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-73683d80-1439-4767-af0d-933fea706711 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.191756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.191756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.191756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.195166] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73683d80-1439-4767-af0d-933fea706711',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.479085] env[62815]: INFO networking_nsxv3.common.synchronization [None req-adb8ea07-61eb-4b69-a3c9-c19777a5fb88 None None] Enqueued Resource ID: d1afd7ac-5aa6-4e13-be6c-1b0dd227f619 with Priority: HIGHEST for action port [ 567.479382] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1afd7ac-5aa6-4e13-be6c-1b0dd227f619 with Priority: HIGHEST for action port [ 567.479941] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1afd7ac-5aa6-4e13-be6c-1b0dd227f619 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.483144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1afd7ac-5aa6-4e13-be6c-1b0dd227f619" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.483231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1afd7ac-5aa6-4e13-be6c-1b0dd227f619" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.483520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1afd7ac-5aa6-4e13-be6c-1b0dd227f619" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.483628] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1afd7ac-5aa6-4e13-be6c-1b0dd227f619',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.581248] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f04c1f5b-752d-41a3-baee-78840d7d6810 None None] Enqueued Resource ID: 5ce712db-58fa-4c76-9817-c4d969e792d7 with Priority: HIGHEST for action port [ 567.581494] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce712db-58fa-4c76-9817-c4d969e792d7 with Priority: HIGHEST for action port [ 567.582037] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ce712db-58fa-4c76-9817-c4d969e792d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.582154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ce712db-58fa-4c76-9817-c4d969e792d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.582254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ce712db-58fa-4c76-9817-c4d969e792d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.582453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ce712db-58fa-4c76-9817-c4d969e792d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.582519] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ce712db-58fa-4c76-9817-c4d969e792d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.694915] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.697291] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.697409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.702175] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73683d80-1439-4767-af0d-933fea706711 with status ACTIVE [ 567.702383] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.702513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.702584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.702794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.702891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.703976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.703976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.703976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.704329] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73683d80-1439-4767-af0d-933fea706711 is going to be updated. [ 567.725485] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.725485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.725485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.725793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.725793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.725913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73683d80-1439-4767-af0d-933fea706711" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.943306] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 567.943909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.944435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.944736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.945028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.945508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.945882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.947159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.947159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.947159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.947159] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.986929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1afd7ac-5aa6-4e13-be6c-1b0dd227f619 [ 567.986929] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.986929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 567.986929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.986929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 567.986929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 567.986929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1afd7ac-5aa6-4e13-be6c-1b0dd227f619 already deleted. [ 567.986929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1afd7ac-5aa6-4e13-be6c-1b0dd227f619" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.087867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ce712db-58fa-4c76-9817-c4d969e792d7 [ 568.088116] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.088283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.088349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.088571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.088651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.088737] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ce712db-58fa-4c76-9817-c4d969e792d7 already deleted. [ 568.088816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ce712db-58fa-4c76-9817-c4d969e792d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.200339] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.450495] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.450495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.450632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.451346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.451693] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.452298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.452298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.452298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.452298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.452848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.452848] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.452848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.452848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.452848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.453075] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.453075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.453542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.453542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.453542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.453542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.453542] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.703077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.703373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.703373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.703619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.703740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.704823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be created. [ 568.741575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.741575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.741575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.741575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.741575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.752121] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: UNINITIALIZED for 2s [ 568.829260] env[62815]: INFO networking_nsxv3.common.synchronization [None req-14b13af4-b461-4cc8-a2d5-98553da7c305 tempest-VolumesAssistedSnapshotsTest-852815796 tempest-VolumesAssistedSnapshotsTest-852815796-project-member] Enqueued Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_rules [ 568.829744] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_rules [ 568.829975] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.831685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.831735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.832049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.832157] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.956529] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b036f05a-9535-4198-b6ab-eff3bdc28054: rpc.has_security_group_logging(os_id): False [ 568.976620] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d68245e9-5c07-4a6f-ac13-f39ef8bd533b tempest-VolumesAssistedSnapshotsTest-852815796 tempest-VolumesAssistedSnapshotsTest-852815796-project-member] Enqueued Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_rules [ 568.977623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.977782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.977857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.978729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.978856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.979112] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.979290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.979362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.979519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.979659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.979779] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.979869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.979932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.980083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.980176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.980329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.980422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 568.980481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.980617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 568.980995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 568.981109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be created. [ 568.982454] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_rules [ 568.982855] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.982954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.052462] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.052599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.052667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.052871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.053054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.068068] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 569.355685] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.355685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.355685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.355907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.355907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.355907] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 already deleted. [ 569.355999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.356141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.356945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.356945] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.880478] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.880884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 569.880884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.880960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 569.881060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 569.881161] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 already deleted. [ 569.881249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.033939] env[62815]: INFO networking_nsxv3.common.synchronization [req-b027020d-2435-4aeb-bcf2-d818ce9fbe22 req-f7006f6f-2a10-44dc-afd8-2090c8a5b7a5 tempest-TenantUsagesTestJSON-1054573724 tempest-TenantUsagesTestJSON-1054573724-project-member] Enqueued Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_members [ 570.033939] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_members [ 570.033939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.033939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.033939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.033939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.033939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.033939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.033939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.035499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.035872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.036130] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.380377] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.380377] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.380377] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.380597] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.380855] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.382948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.383193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.383561] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.383639] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.384026] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 570.384172] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 570.384289] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 570.384412] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 570.384528] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 570.384657] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 570.384796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 570.406178] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 570.406321] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 570.406424] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 570.407234] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.407234] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e8e56e09-c443-4540-9890-814575847dd7 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.407234] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.407234] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.408026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.408026] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e56e09-c443-4540-9890-814575847dd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.523267] env[62815]: INFO networking_nsxv3.common.synchronization [None req-ac8f385b-82e1-4571-bc8b-2684ed9aedb3 None None] Enqueued Resource ID: 6eea92e2-af72-4ee2-ad9c-a905690ed487 with Priority: HIGHEST for action port [ 570.523267] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eea92e2-af72-4ee2-ad9c-a905690ed487 with Priority: HIGHEST for action port [ 570.523267] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eea92e2-af72-4ee2-ad9c-a905690ed487 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.523267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eea92e2-af72-4ee2-ad9c-a905690ed487" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.523267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eea92e2-af72-4ee2-ad9c-a905690ed487" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.523267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eea92e2-af72-4ee2-ad9c-a905690ed487" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.523267] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eea92e2-af72-4ee2-ad9c-a905690ed487',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.539383] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.539601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.539671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.539907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.539960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.540949] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.540949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.540949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.540949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.540949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.540949] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 already deleted. [ 570.540949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.617860] env[62815]: INFO networking_nsxv3.common.synchronization [None req-748131d7-1eda-4e72-a05c-b3715d1b5d05 None None] Enqueued Resource ID: 3e98bfed-f8f8-4b6a-96d3-3234abd4c979 with Priority: HIGHEST for action port [ 570.617860] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e98bfed-f8f8-4b6a-96d3-3234abd4c979 with Priority: HIGHEST for action port [ 570.617860] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e98bfed-f8f8-4b6a-96d3-3234abd4c979 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.617860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e98bfed-f8f8-4b6a-96d3-3234abd4c979" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.617860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e98bfed-f8f8-4b6a-96d3-3234abd4c979" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.617860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e98bfed-f8f8-4b6a-96d3-3234abd4c979" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.617860] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e98bfed-f8f8-4b6a-96d3-3234abd4c979',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.764207] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.764207] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.764207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.764207] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.912232] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.912232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.912232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.912232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.912743] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.912990] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e8e56e09-c443-4540-9890-814575847dd7 not found, creating... [ 570.913760] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.913986] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.914211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.914517] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.914718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.915272] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.915506] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.916013] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.916270] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.916430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.917027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e8e56e09-c443-4540-9890-814575847dd7 is going to be created. [ 570.942956] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.943233] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.943383] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.943711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.944022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.944922] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 570.951730] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d079a390-8538-47bd-8c9b-ad959b30d25d tempest-ServerActionsV293TestJSON-1409986256 tempest-ServerActionsV293TestJSON-1409986256-project-member] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_rules [ 570.951974] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_rules [ 570.952546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.952669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 570.952725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.953024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 570.953108] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.025736] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eea92e2-af72-4ee2-ad9c-a905690ed487 [ 571.025992] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.026203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.026293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.026571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.026714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.026819] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eea92e2-af72-4ee2-ad9c-a905690ed487 already deleted. [ 571.026922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eea92e2-af72-4ee2-ad9c-a905690ed487" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.087891] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 571.088552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.123691] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e98bfed-f8f8-4b6a-96d3-3234abd4c979 [ 571.123691] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.124460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.124460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.124460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.124460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.124460] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e98bfed-f8f8-4b6a-96d3-3234abd4c979 already deleted. [ 571.124747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e98bfed-f8f8-4b6a-96d3-3234abd4c979" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.261489] env[62815]: INFO networking_nsxv3.common.synchronization [None req-95b77a90-bb87-4bce-b0c5-4d347be64a2b tempest-ServerActionsV293TestJSON-1409986256 tempest-ServerActionsV293TestJSON-1409986256-project-member] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_rules [ 571.262007] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_rules [ 571.262315] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.262983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.269571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.269571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.269571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.269822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.269822] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.269916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.269949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.270112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.271143] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.271143] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.271143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.271816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.271816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.271816] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.477281] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.477281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.477281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.477281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.477281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.477281] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 already deleted. [ 571.477281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.478456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.478456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.478456] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.774754] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73cab825-2378-45d6-b89b-7d11138b2d06: rpc.has_security_group_logging(os_id): False [ 571.803850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.804025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.804130] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.805040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.805040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.805040] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.805040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.805235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.805341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.805857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.805857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.805857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.806088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.806349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.806349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.806770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.806770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.807577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.807577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.807687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.807717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be created. [ 571.897290] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.897517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.897601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.897868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.898127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 571.910139] env[62815]: INFO networking_nsxv3.common.synchronization [req-97cca461-b74d-499c-9de3-90bdcb82bdbd req-25c3b29a-ccae-47a4-a76c-6873644243b8 tempest-SecurityGroupRulesNegativeTestJSON-1676592400 tempest-SecurityGroupRulesNegativeTestJSON-1676592400-project-member] Enqueued Resource ID: 5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b with Priority: HIGHEST for action security_group_rules [ 571.911016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b with Priority: HIGHEST for action security_group_rules [ 571.911843] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.912022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 571.912267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.912598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 571.912598] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.925020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 2s [ 572.026930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.027097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.027248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.027397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.027512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.027604] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 already deleted. [ 572.027689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.219307] env[62815]: INFO networking_nsxv3.common.synchronization [req-b027020d-2435-4aeb-bcf2-d818ce9fbe22 req-0f032375-a0cb-4aed-b263-008827022f2a service nova] Enqueued Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_rules [ 572.219307] env[62815]: INFO networking_nsxv3.common.synchronization [req-b027020d-2435-4aeb-bcf2-d818ce9fbe22 req-0f032375-a0cb-4aed-b263-008827022f2a service nova] Enqueued Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_members [ 572.219465] env[62815]: INFO networking_nsxv3.common.synchronization [req-b027020d-2435-4aeb-bcf2-d818ce9fbe22 req-0f032375-a0cb-4aed-b263-008827022f2a service nova] Enqueued Resource ID: e8e56e09-c443-4540-9890-814575847dd7 with Priority: HIGHEST for action port [ 572.219689] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_rules [ 572.219818] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_members [ 572.219914] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8e56e09-c443-4540-9890-814575847dd7 with Priority: HIGHEST for action port [ 572.220445] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.220576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.220797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.220909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.220992] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.222635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.224032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.224032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.224032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.224032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.224032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.224032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.224492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.224492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.224492] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.228694] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8e56e09-c443-4540-9890-814575847dd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.228816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.228866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.229028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.229102] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e56e09-c443-4540-9890-814575847dd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.436081] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.437045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.437045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.437045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.437045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.437045] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b already deleted. [ 572.437045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.632549] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c21599e2-c7b4-4697-8735-2be878bde986 None None] Enqueued Resource ID: ab3ffc61-c295-45ba-9510-e94f9a4ea36c with Priority: HIGHEST for action port [ 572.632861] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab3ffc61-c295-45ba-9510-e94f9a4ea36c with Priority: HIGHEST for action port [ 572.633388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab3ffc61-c295-45ba-9510-e94f9a4ea36c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.633532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab3ffc61-c295-45ba-9510-e94f9a4ea36c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.633611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab3ffc61-c295-45ba-9510-e94f9a4ea36c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.633864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab3ffc61-c295-45ba-9510-e94f9a4ea36c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.633940] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab3ffc61-c295-45ba-9510-e94f9a4ea36c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.732577] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.732799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.732998] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.737663] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8e56e09-c443-4540-9890-814575847dd7 with status ACTIVE [ 572.737663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.737663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.737663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.737663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.737663] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8e56e09-c443-4540-9890-814575847dd7 is going to be updated. [ 572.740525] env[62815]: INFO networking_nsxv3.common.synchronization [req-917f4999-69ba-4bd1-905a-497dc143930b req-8d5ed17e-bd86-4a4a-8e85-a5224f923b73 tempest-ServerExternalEventsTest-930270806 tempest-ServerExternalEventsTest-930270806-project-member] Enqueued Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_members [ 572.741554] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_members [ 572.742558] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.742827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.742890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.743237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.743480] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.743622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.743787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.743909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.744959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.744959] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.766854] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.767102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 572.767102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.767295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 572.767441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 572.767597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8e56e09-c443-4540-9890-814575847dd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.141203] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab3ffc61-c295-45ba-9510-e94f9a4ea36c [ 573.141203] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.141203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.141203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.144934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.144934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.144934] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab3ffc61-c295-45ba-9510-e94f9a4ea36c already deleted. [ 573.144934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab3ffc61-c295-45ba-9510-e94f9a4ea36c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.242161] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.250447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.250447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.250447] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 already deleted. [ 573.250447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.316549] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.316549] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.316647] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.316890] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.317197] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.317364] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.317484] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.317727] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.318521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.320332] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 573.320332] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 573.320527] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 573.320676] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 573.320875] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 573.324040] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 573.324040] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 573.343668] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 573.343668] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 573.343668] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 573.343668] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.343668] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.343668] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.343668] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.343668] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.343668] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff5ec33c-060d-4f16-a82b-fa13a1e5e21e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.744685] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.744835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.744977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.745143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.745242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.745357] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 is going to be created. [ 573.775385] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.775570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.775649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.775879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.775947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.790158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 in Status: UNINITIALIZED for 2s [ 573.846971] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.847225] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.847360] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.847665] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.847826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.847984] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port ff5ec33c-060d-4f16-a82b-fa13a1e5e21e not found, creating... [ 573.848339] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.848557] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.848670] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.848855] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.848995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.849307] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.849465] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.849581] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.849803] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.849937] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.851912] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: ff5ec33c-060d-4f16-a82b-fa13a1e5e21e is going to be created. [ 573.872492] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.872733] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 573.872869] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.873257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 573.873513] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.873752] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 573.950421] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 573.950421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.045173] env[62815]: INFO networking_nsxv3.common.synchronization [req-f7751859-0b01-4d6e-a329-5b0775c556f6 req-b0fc4bb0-6802-4e24-8cb9-b568eaa1f3fc tempest-SecurityGroupRulesNegativeTestJSON-1676592400 tempest-SecurityGroupRulesNegativeTestJSON-1676592400-project-member] Enqueued Resource ID: 5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b with Priority: HIGHEST for action security_group_rules [ 574.045173] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b with Priority: HIGHEST for action security_group_rules [ 574.045173] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.045173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.045173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.045173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.045173] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.572021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.572021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.572021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.572021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.572021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.572021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b already deleted. [ 574.572021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5486cc3b-1edd-47bc-a6e1-c8c32b1ae29b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 574.581337] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f7749521-a05b-4dec-a909-48b3655ed1a3 None None] Enqueued Resource ID: 37fda032-bb14-4cec-9c2b-f1b46360fcb4 with Priority: HIGHEST for action port [ 574.582257] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fda032-bb14-4cec-9c2b-f1b46360fcb4 with Priority: HIGHEST for action port [ 574.584135] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-37fda032-bb14-4cec-9c2b-f1b46360fcb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.586015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37fda032-bb14-4cec-9c2b-f1b46360fcb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.586497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37fda032-bb14-4cec-9c2b-f1b46360fcb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.587673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37fda032-bb14-4cec-9c2b-f1b46360fcb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.587924] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37fda032-bb14-4cec-9c2b-f1b46360fcb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.989321] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d18b33ae-c0b4-42f5-8064-0a14fb8e434c tempest-ServersWithSpecificFlavorTestJSON-887013430 tempest-ServersWithSpecificFlavorTestJSON-887013430-project-member] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 574.989878] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 574.990194] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.990316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 574.990385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.990833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 574.990833] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.094197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37fda032-bb14-4cec-9c2b-f1b46360fcb4 [ 575.094197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.094197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.094197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.094197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.094197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.094197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37fda032-bb14-4cec-9c2b-f1b46360fcb4 already deleted. [ 575.094197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37fda032-bb14-4cec-9c2b-f1b46360fcb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.261115] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a5fa4ced-aaf7-4621-9638-da4bc59b22d4 tempest-ServersWithSpecificFlavorTestJSON-887013430 tempest-ServersWithSpecificFlavorTestJSON-887013430-project-member] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 575.261115] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 575.261115] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.261115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.468578] env[62815]: INFO networking_nsxv3.common.synchronization [req-68d9c162-d2c3-4c4c-9717-7fcd05b94a08 req-b923a46b-707b-4870-9a82-fb1094f7d1bb tempest-ServersTestJSON-2023342580 tempest-ServersTestJSON-2023342580-project-member] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_members [ 575.471310] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_members [ 575.471640] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.471759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.471859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.472215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.472369] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.472523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.472773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.472773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.472863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.472961] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.529248] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.529248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.529248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.529572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.529783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.531686] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a360f68-c409-4d28-9396-e41a05128638 already deleted. [ 575.531686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.531686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.531686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.531686] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.804889] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 in Status: SUCCESS [ 575.805539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.805539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.809027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.809027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.809027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.809027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.809027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.809027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.809027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.809027] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.941874] env[62815]: INFO networking_nsxv3.common.synchronization [req-917f4999-69ba-4bd1-905a-497dc143930b req-1d2607ae-6db0-48bb-a534-6b1d26e7bac0 service nova] Enqueued Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_rules [ 575.941874] env[62815]: INFO networking_nsxv3.common.synchronization [req-917f4999-69ba-4bd1-905a-497dc143930b req-1d2607ae-6db0-48bb-a534-6b1d26e7bac0 service nova] Enqueued Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_members [ 575.941874] env[62815]: INFO networking_nsxv3.common.synchronization [req-917f4999-69ba-4bd1-905a-497dc143930b req-1d2607ae-6db0-48bb-a534-6b1d26e7bac0 service nova] Enqueued Resource ID: ff5ec33c-060d-4f16-a82b-fa13a1e5e21e with Priority: HIGHEST for action port [ 575.941874] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_rules [ 575.941874] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_members [ 575.941874] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff5ec33c-060d-4f16-a82b-fa13a1e5e21e with Priority: HIGHEST for action port [ 575.942091] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.942158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.942158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.942979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.942979] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.949025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.949025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.949025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.950422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.950523] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.950628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.950689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.950979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.950979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.951211] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.956404] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.956404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.956404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.956404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.956404] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff5ec33c-060d-4f16-a82b-fa13a1e5e21e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.977467] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.977614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.977681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.977891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.977978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.978324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.978324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 575.978440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.978505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 575.980127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 575.980127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 already deleted. [ 575.980127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.060672] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.060798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.060869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.061101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.061188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.061334] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a360f68-c409-4d28-9396-e41a05128638 already deleted. [ 576.061388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.126537] env[62815]: INFO networking_nsxv3.common.synchronization [None req-87407fd5-0983-4caa-9ead-71795146ce6f None None] Enqueued Resource ID: fd9cce15-9e9c-4b92-b45c-2555683a95ef with Priority: HIGHEST for action port [ 576.126896] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9cce15-9e9c-4b92-b45c-2555683a95ef with Priority: HIGHEST for action port [ 576.127262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd9cce15-9e9c-4b92-b45c-2555683a95ef taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.127434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd9cce15-9e9c-4b92-b45c-2555683a95ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.127529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd9cce15-9e9c-4b92-b45c-2555683a95ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.127755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd9cce15-9e9c-4b92-b45c-2555683a95ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.127987] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd9cce15-9e9c-4b92-b45c-2555683a95ef',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.312224] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.312382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.312453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.312668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.312835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.312932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.312993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.313154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.313232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.313320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.313458] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.313579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.313649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.313827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.313966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.314096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.314137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.314635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.314713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.314801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.314885] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.449682] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.449682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.459451] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.461026] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff5ec33c-060d-4f16-a82b-fa13a1e5e21e with status ACTIVE [ 576.461026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.461026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.461026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.464140] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.464140] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.464140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.464748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.465270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.465403] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff5ec33c-060d-4f16-a82b-fa13a1e5e21e is going to be updated. [ 576.486950] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff5ec33c-060d-4f16-a82b-fa13a1e5e21e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.630925] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd9cce15-9e9c-4b92-b45c-2555683a95ef [ 576.631554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.631554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.631554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.632464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.632464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.632464] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd9cce15-9e9c-4b92-b45c-2555683a95ef already deleted. [ 576.632464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd9cce15-9e9c-4b92-b45c-2555683a95ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.823231] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9aee6bbb-a299-4192-aa7a-87a17036d3e8: rpc.has_security_group_logging(os_id): False [ 576.847492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.847492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.847492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.847492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.847492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.847758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.847812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.847956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.848525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.848525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.848525] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.848525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.848525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.848735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.848735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.848890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.848972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.850066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.851823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.851823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.851823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 is going to be created. [ 576.957434] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.957672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 576.957672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.957883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 576.958115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 576.968779] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.987644] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 in Status: IN_PROGRESS for 2s [ 577.054332] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.054332] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-211" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.054332] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-211" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.054557] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-211" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.054775] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.054944] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.055855] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.057440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.057440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.057440] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.057440] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 577.057440] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 577.057440] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 577.057440] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.057440] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 577.057440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 577.098823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 577.099022] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 577.099146] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 577.099368] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-211" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.099681] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.099857] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.099974] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.100340] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.100476] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f2f8e32-e7d3-4390-b1ab-1aa117445a66',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.327279] env[62815]: INFO networking_nsxv3.common.synchronization [req-39555a2c-494b-4a9b-991d-b88ace062975 req-1699f040-3c20-45fb-8fcc-37287f8624ed tempest-ServerDiagnosticsTest-1072401595 tempest-ServerDiagnosticsTest-1072401595-project-member] Enqueued Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_members [ 577.327698] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_members [ 577.328106] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.328265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.328386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.328670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.328848] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.328975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.329054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.329449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.329548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.329548] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.474169] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.474169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.474169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.474169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.474169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.474169] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 is going to be created. [ 577.499476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.499736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.499827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.500116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.500292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.515943] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 in Status: UNINITIALIZED for 2s [ 577.604556] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.608024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 5f2f8e32-e7d3-4390-b1ab-1aa117445a66 not found, creating... [ 577.608024] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.608024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.613127] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.613127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.613127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.613127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.613127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.613127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 5f2f8e32-e7d3-4390-b1ab-1aa117445a66 is going to be created. [ 577.634129] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.634129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.634129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.634129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.634129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.634129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.832908] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.832908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.832908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.832908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.833570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.833570] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.833570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.833751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.833860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.835379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.835379] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 already deleted. [ 577.835379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.970049] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.970049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.970049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.970049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.970049] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.970049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.970049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.972069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.972260] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.972464] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.972582] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 577.972694] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 577.972804] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 577.972911] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.973026] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 577.973166] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 577.995240] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 577.995240] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 577.995366] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 577.996041] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 577.996499] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-f08bd933-a0cd-4656-baf2-e373fefbd4fd taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.996702] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 577.996828] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.997238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 577.997879] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f08bd933-a0cd-4656-baf2-e373fefbd4fd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.359949] env[62815]: INFO networking_nsxv3.common.synchronization [req-68d9c162-d2c3-4c4c-9717-7fcd05b94a08 req-c3712300-2784-40b3-a99f-32214b69c58f service nova] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_rules [ 578.360273] env[62815]: INFO networking_nsxv3.common.synchronization [req-68d9c162-d2c3-4c4c-9717-7fcd05b94a08 req-c3712300-2784-40b3-a99f-32214b69c58f service nova] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_members [ 578.360323] env[62815]: INFO networking_nsxv3.common.synchronization [req-68d9c162-d2c3-4c4c-9717-7fcd05b94a08 req-c3712300-2784-40b3-a99f-32214b69c58f service nova] Enqueued Resource ID: 5f2f8e32-e7d3-4390-b1ab-1aa117445a66 with Priority: HIGHEST for action port [ 578.361498] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_rules [ 578.361553] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_members [ 578.363265] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f2f8e32-e7d3-4390-b1ab-1aa117445a66 with Priority: HIGHEST for action port [ 578.363265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.363265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.363265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.363265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.363265] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.366244] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.366391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.366463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.366657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.366807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.366938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.366980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.367146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.367234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.368022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.368198] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.368260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.368374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.368443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.368513] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f2f8e32-e7d3-4390-b1ab-1aa117445a66',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.502629] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.505953] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port f08bd933-a0cd-4656-baf2-e373fefbd4fd not found, creating... [ 578.505953] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.505953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.506567] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.506567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.506567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.506567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.506567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.507090] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: f08bd933-a0cd-4656-baf2-e373fefbd4fd is going to be created. [ 578.527271] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.527271] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.527444] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.527631] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.527861] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.528096] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.670622] env[62815]: INFO networking_nsxv3.common.synchronization [None req-888d69c2-b638-4bdb-a644-02ceaf1621c9 None None] Enqueued Resource ID: 17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0 with Priority: HIGHEST for action port [ 578.670806] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0 with Priority: HIGHEST for action port [ 578.671824] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.671824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.671824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.672954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.673248] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.870894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.874700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.874700] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.874700] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f2f8e32-e7d3-4390-b1ab-1aa117445a66 with status ACTIVE [ 578.874700] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.874700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.874700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.874700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.874700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.874700] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.876344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.876577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.876868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.877198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.878282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.878282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.878282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.878282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.878746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.878946] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f2f8e32-e7d3-4390-b1ab-1aa117445a66 is going to be updated. [ 578.903269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.903466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 578.903566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.903885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 578.904077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 578.904273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f2f8e32-e7d3-4390-b1ab-1aa117445a66" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.014074] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 in Status: SUCCESS [ 579.014279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.178432] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0 [ 579.178833] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.178833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.178962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.179148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.179258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.179381] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0 already deleted. [ 579.179510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17b5cbc8-0c3f-41ed-8a2f-8b8db9e94dc0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.283017] env[62815]: INFO networking_nsxv3.common.synchronization [req-ab771f4a-2589-4a85-937e-38a98d8ab205 req-0e263d9a-81be-4362-9184-6759689030e7 tempest-ImagesOneServerTestJSON-1093200441 tempest-ImagesOneServerTestJSON-1093200441-project-member] Enqueued Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_members [ 579.283554] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_members [ 579.283868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.283993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.284071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.284324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.284486] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.284590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.284653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.284801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.284890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.284981] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.381147] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.529123] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 in Status: SUCCESS [ 579.529433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.529622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.529837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.530050] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.530170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.530232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.530382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.530461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.530588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.530622] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.647917] env[62815]: INFO networking_nsxv3.common.synchronization [req-39555a2c-494b-4a9b-991d-b88ace062975 req-5ee69dfe-e6a9-43d6-8a48-c848f4b42f98 service nova] Enqueued Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_rules [ 579.648089] env[62815]: INFO networking_nsxv3.common.synchronization [req-39555a2c-494b-4a9b-991d-b88ace062975 req-5ee69dfe-e6a9-43d6-8a48-c848f4b42f98 service nova] Enqueued Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_members [ 579.648271] env[62815]: INFO networking_nsxv3.common.synchronization [req-39555a2c-494b-4a9b-991d-b88ace062975 req-5ee69dfe-e6a9-43d6-8a48-c848f4b42f98 service nova] Enqueued Resource ID: f08bd933-a0cd-4656-baf2-e373fefbd4fd with Priority: HIGHEST for action port [ 579.648622] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_rules [ 579.648732] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_members [ 579.648829] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f08bd933-a0cd-4656-baf2-e373fefbd4fd with Priority: HIGHEST for action port [ 579.649652] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.649815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.649973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.650204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.650282] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.652042] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.652340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.652409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.652643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.652833] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.652882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.652943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.653117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.653214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.653281] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.654023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f08bd933-a0cd-4656-baf2-e373fefbd4fd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.654128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.654193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.654349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.654482] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f08bd933-a0cd-4656-baf2-e373fefbd4fd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.791475] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.793293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.793616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.793889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.793992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.794229] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.794347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.794414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.794596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.794680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.794771] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d already deleted. [ 579.794853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.799815] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-674" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-674" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-674" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.799815] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.799815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.800671] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 579.800671] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 579.800671] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 579.800671] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 579.800671] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 579.802037] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 579.802037] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 579.819564] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 579.819624] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 579.819848] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 579.820033] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-674" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.820235] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e8238231-b39f-4e0e-b02e-e68a4277e2d9 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.820437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.820561] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.820960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.821052] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8238231-b39f-4e0e-b02e-e68a4277e2d9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.885067] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.885395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.885395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.885909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.886502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.886502] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 is going to be created. [ 579.912879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.913034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 579.913105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.913315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 579.913472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 579.922740] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 in Status: UNINITIALIZED for 2s [ 580.032927] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.033225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.033300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.033556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.033761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.033893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.033962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.034198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.034316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.034413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.034568] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.034662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.034887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.034887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.034995] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.035100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.035228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.035345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.035431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.035528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.035670] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.157377] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.160367] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.160367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.160367] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f08bd933-a0cd-4656-baf2-e373fefbd4fd with status ACTIVE [ 580.160367] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.160367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.160367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.160367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.160367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.160367] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.160776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.160776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.160890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.160944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.161164] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.161355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.161425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.161919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.162077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.162344] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f08bd933-a0cd-4656-baf2-e373fefbd4fd is going to be updated. [ 580.185997] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.185997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.185997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.185997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.185997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.185997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f08bd933-a0cd-4656-baf2-e373fefbd4fd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.324107] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.327142] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e8238231-b39f-4e0e-b02e-e68a4277e2d9 not found, creating... [ 580.327142] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.327142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.328719] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.328719] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.328719] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.328719] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.328719] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.329235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e8238231-b39f-4e0e-b02e-e68a4277e2d9 is going to be created. [ 580.349565] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.349781] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.349920] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.350257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.350500] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.350774] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.540410] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2f3140d-d06d-40e7-9719-ba1446ff3270: rpc.has_security_group_logging(os_id): False [ 580.564659] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.564820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.564885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.565128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.565242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.565433] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.565527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.565583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.565726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.565803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.565991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.566099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.566164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.566360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.566360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.566547] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.566644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.566705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.566845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.566926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.567094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 is going to be created. [ 580.635432] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.636222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 580.636300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.636520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 580.636699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 580.651131] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 in Status: IN_PROGRESS for 2s [ 580.665086] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.171839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.171839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.171839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.171839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.171839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.171839] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 is going to be created. [ 581.197954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.197954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.197954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.197954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.197954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.207781] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 in Status: UNINITIALIZED for 2s [ 581.385164] env[62815]: INFO networking_nsxv3.common.synchronization [req-ab771f4a-2589-4a85-937e-38a98d8ab205 req-a4555deb-1d3e-4bf4-9720-fcf5c89f1ada service nova] Enqueued Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_rules [ 581.385341] env[62815]: INFO networking_nsxv3.common.synchronization [req-ab771f4a-2589-4a85-937e-38a98d8ab205 req-a4555deb-1d3e-4bf4-9720-fcf5c89f1ada service nova] Enqueued Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_members [ 581.385341] env[62815]: INFO networking_nsxv3.common.synchronization [req-ab771f4a-2589-4a85-937e-38a98d8ab205 req-a4555deb-1d3e-4bf4-9720-fcf5c89f1ada service nova] Enqueued Resource ID: e8238231-b39f-4e0e-b02e-e68a4277e2d9 with Priority: HIGHEST for action port [ 581.386259] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_rules [ 581.386259] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_members [ 581.386259] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8238231-b39f-4e0e-b02e-e68a4277e2d9 with Priority: HIGHEST for action port [ 581.386861] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.387171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.387973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.387973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.387973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.388862] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.388947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.389209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.389321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.389687] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.389891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.390211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.390211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.390421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.390421] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.391152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8238231-b39f-4e0e-b02e-e68a4277e2d9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.391298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.391333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.391477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.391560] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8238231-b39f-4e0e-b02e-e68a4277e2d9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.893424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.893424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.895086] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.901794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8238231-b39f-4e0e-b02e-e68a4277e2d9 with status ACTIVE [ 581.901794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.901794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.901794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.903590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.903590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.903590] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.903801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.903801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.904039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.904416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.904416] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.904579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.904622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.904820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.904892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.904978] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8238231-b39f-4e0e-b02e-e68a4277e2d9 is going to be updated. [ 581.960638] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 in Status: SUCCESS [ 581.960638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.960786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.960985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.961222] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.961346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.961413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.961609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.961700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.961787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.961877] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.973734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.973734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 581.974375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.974721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 581.974843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 581.975014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8238231-b39f-4e0e-b02e-e68a4277e2d9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.398297] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.465725] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.668047] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 in Status: SUCCESS [ 582.668047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.903116] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.904265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.904345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.904567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.904665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.904771] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d is going to be created. [ 582.916793] env[62815]: INFO networking_nsxv3.common.synchronization [None req-53858bc3-551a-454f-ba0c-a56ef00cfbda None None] Enqueued Resource ID: e17255c5-f1be-4018-a2de-2640cb33206d with Priority: HIGHEST for action port [ 582.917066] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17255c5-f1be-4018-a2de-2640cb33206d with Priority: HIGHEST for action port [ 582.920325] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e17255c5-f1be-4018-a2de-2640cb33206d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.920325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e17255c5-f1be-4018-a2de-2640cb33206d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.920325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e17255c5-f1be-4018-a2de-2640cb33206d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.920325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e17255c5-f1be-4018-a2de-2640cb33206d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.920325] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e17255c5-f1be-4018-a2de-2640cb33206d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.930885] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.930885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.930885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.930885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.931118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.945243] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d in Status: UNINITIALIZED for 2s [ 582.971264] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35758e4-45cb-490c-89ec-fb2fd51be5f9: rpc.has_security_group_logging(os_id): False [ 582.994850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.995059] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.995141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.995366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.995455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.995701] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.996313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 582.996313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.996313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 582.996313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 582.996313] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 is going to be created. [ 583.063510] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.063687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.063770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.064016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.064193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.077514] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 in Status: IN_PROGRESS for 2s [ 583.166642] env[62815]: INFO networking_nsxv3.common.synchronization [req-024e4ac9-aa2f-4d68-b7ee-8e57e1f21b49 req-5ac7d608-b141-4615-88f3-2e9a4bce0915 tempest-DeleteServersAdminTestJSON-929573088 tempest-DeleteServersAdminTestJSON-929573088-project-admin] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 583.167055] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 583.167367] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.167494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.167562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.167776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.167928] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.170161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.170161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.170161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.170161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.170161] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.219208] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 in Status: SUCCESS [ 583.219839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.220014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.220226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.220498] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.220636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.220636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.220853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.220972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.221110] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.221868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.422696] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e17255c5-f1be-4018-a2de-2640cb33206d [ 583.423046] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.423120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.423156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.423370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.423471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.423559] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e17255c5-f1be-4018-a2de-2640cb33206d already deleted. [ 583.423640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e17255c5-f1be-4018-a2de-2640cb33206d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.676351] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.676351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.676351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.676351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.676351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.676552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.676634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.676668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.676914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.677033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.677166] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be updated. [ 583.725448] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.726654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.728649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.728649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.728649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.728785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.728819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.729009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.729105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.729575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.729575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.729575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.729575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.730049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.730049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.730049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.730049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.730209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.730311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.730311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.730391] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.738039] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.738272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 583.738347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.738634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 583.738783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 583.751866] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 2s [ 584.235857] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1a7e1c-300f-43dc-b3c7-fe7528e023f3: rpc.has_security_group_logging(os_id): False [ 584.260764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.260764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.260764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.260764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.266481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.266481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.266481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.266481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.266481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.266481] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 is going to be created. [ 584.329578] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.329735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.329805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.330038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.330200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.348604] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 in Status: IN_PROGRESS for 2s [ 584.850803] env[62815]: INFO networking_nsxv3.common.synchronization [None req-ea1d5cac-8acf-4e8f-8c7d-84bae42b5cb1 None None] Enqueued Resource ID: b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7 with Priority: HIGHEST for action port [ 584.852396] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7 with Priority: HIGHEST for action port [ 584.852396] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.852396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.852396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.856273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.856379] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.959260] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d in Status: SUCCESS [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.959260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.959260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 584.959260] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.091500] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 in Status: SUCCESS [ 585.092299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.359987] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7 [ 585.363440] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.363440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.363440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.363440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.363440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.363440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7 already deleted. [ 585.363440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1d5473b-d2b7-42d7-b0c7-3c5f3533e0b7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.462836] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.465457] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.465457] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.465457] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.465457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.466214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.466214] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.553062] env[62815]: INFO networking_nsxv3.common.synchronization [req-31863f40-0d3e-4470-9593-cb850a6c69e9 req-364905a1-dd42-43ab-8032-75be95e24fcf tempest-VolumesAssistedSnapshotsTest-852815796 tempest-VolumesAssistedSnapshotsTest-852815796-project-member] Enqueued Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_members [ 585.553493] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_members [ 585.554179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.555038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.555038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.555038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.556364] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.556364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.556364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.556364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.556364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.556822] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.764056] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 585.764314] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 deletion is rescheduled due to dependency. [ 585.764365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.970682] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d: rpc.has_security_group_logging(os_id): False [ 585.989695] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.989851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.989953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.993320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.993519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.993780] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.993987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.993987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.994168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.994387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.994460] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.994642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.994642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.994759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.995047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.995047] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.999032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 585.999032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.999032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 585.999032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 585.999032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d is going to be created. [ 586.053797] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.053990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.053990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.054339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.054630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.062492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.062662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.062704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.062929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.063223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.063223] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.063431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.063431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.063548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.063708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.063764] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 already deleted. [ 586.063865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.065328] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d in Status: IN_PROGRESS for 2s [ 586.337295] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2b97950c-23eb-4617-bca9-c8d41041a8fb None None] Enqueued Resource ID: 58686322-33fe-4693-b01d-5f1c9eec14bb with Priority: HIGHEST for action port [ 586.337295] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58686322-33fe-4693-b01d-5f1c9eec14bb with Priority: HIGHEST for action port [ 586.337493] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-58686322-33fe-4693-b01d-5f1c9eec14bb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.337493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58686322-33fe-4693-b01d-5f1c9eec14bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.337593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58686322-33fe-4693-b01d-5f1c9eec14bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.337983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58686322-33fe-4693-b01d-5f1c9eec14bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.337983] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58686322-33fe-4693-b01d-5f1c9eec14bb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.363100] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 in Status: SUCCESS [ 586.363334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.597618] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.598811] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.598984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.599449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.602159] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.602159] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.602159] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.602159] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.602159] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.602159] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 586.602159] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.602608] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.602608] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.602608] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 586.602608] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.602730] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.628298] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.628540] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 586.628702] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.628894] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.629284] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-05cc2d8e-6ff5-4046-8a68-215c985018dd taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.629480] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.629598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.629954] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.630116] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cc2d8e-6ff5-4046-8a68-215c985018dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.844056] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58686322-33fe-4693-b01d-5f1c9eec14bb [ 586.845908] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.845908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 586.845908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.845908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 586.845908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 586.845908] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58686322-33fe-4693-b01d-5f1c9eec14bb already deleted. [ 586.845908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58686322-33fe-4693-b01d-5f1c9eec14bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.133484] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.133881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.134141] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.134506] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.134718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.134937] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 05cc2d8e-6ff5-4046-8a68-215c985018dd not found, creating... [ 587.135380] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.135485] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.138715] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.138715] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.138715] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.138911] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.139043] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.139169] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.139471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.139678] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.139833] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 05cc2d8e-6ff5-4046-8a68-215c985018dd is going to be created. [ 587.160505] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.160649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.162769] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.162769] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.162769] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.162769] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.459356] env[62815]: INFO networking_nsxv3.common.synchronization [None req-ba1722f1-4623-4a02-9abd-0708ec350dd8 None None] Enqueued Resource ID: 33252ae5-c239-4ca5-a4d7-cc058bbc1aa9 with Priority: HIGHEST for action port [ 587.461501] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33252ae5-c239-4ca5-a4d7-cc058bbc1aa9 with Priority: HIGHEST for action port [ 587.462132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-33252ae5-c239-4ca5-a4d7-cc058bbc1aa9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.462354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33252ae5-c239-4ca5-a4d7-cc058bbc1aa9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.462471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33252ae5-c239-4ca5-a4d7-cc058bbc1aa9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.462971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33252ae5-c239-4ca5-a4d7-cc058bbc1aa9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.463527] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33252ae5-c239-4ca5-a4d7-cc058bbc1aa9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.663426] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c1dcedbf-dd98-4684-83b9-ab1b879777be tempest-ServersTestBootFromVolume-393267422 tempest-ServersTestBootFromVolume-393267422-project-member] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_rules [ 587.664768] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_rules [ 587.665883] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.667701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.667701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.667701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.667701] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.761289] env[62815]: INFO networking_nsxv3.common.synchronization [None req-7d2a6dd9-cc71-4505-a588-37ddf27f4882 None None] Enqueued Resource ID: ee37c1c1-598e-48f2-b822-1dae4d87bbb5 with Priority: HIGHEST for action port [ 587.761289] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee37c1c1-598e-48f2-b822-1dae4d87bbb5 with Priority: HIGHEST for action port [ 587.761289] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee37c1c1-598e-48f2-b822-1dae4d87bbb5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.761289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee37c1c1-598e-48f2-b822-1dae4d87bbb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.761289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee37c1c1-598e-48f2-b822-1dae4d87bbb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.761963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee37c1c1-598e-48f2-b822-1dae4d87bbb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.761963] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee37c1c1-598e-48f2-b822-1dae4d87bbb5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.967721] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33252ae5-c239-4ca5-a4d7-cc058bbc1aa9 [ 587.967938] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.968067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 587.968146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.968356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 587.968512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.968560] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33252ae5-c239-4ca5-a4d7-cc058bbc1aa9 already deleted. [ 587.968664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33252ae5-c239-4ca5-a4d7-cc058bbc1aa9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 587.999063] env[62815]: INFO networking_nsxv3.common.synchronization [req-31863f40-0d3e-4470-9593-cb850a6c69e9 req-79e75c8a-c827-45b6-b18c-4d66fdfd8f57 service nova] Enqueued Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_rules [ 587.999600] env[62815]: INFO networking_nsxv3.common.synchronization [req-31863f40-0d3e-4470-9593-cb850a6c69e9 req-79e75c8a-c827-45b6-b18c-4d66fdfd8f57 service nova] Enqueued Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_members [ 587.999772] env[62815]: INFO networking_nsxv3.common.synchronization [req-31863f40-0d3e-4470-9593-cb850a6c69e9 req-79e75c8a-c827-45b6-b18c-4d66fdfd8f57 service nova] Enqueued Resource ID: 05cc2d8e-6ff5-4046-8a68-215c985018dd with Priority: HIGHEST for action port [ 588.000044] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_rules [ 588.000157] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_members [ 588.000249] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05cc2d8e-6ff5-4046-8a68-215c985018dd with Priority: HIGHEST for action port [ 588.000854] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.000913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.000956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.003300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.003300] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.003300] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.003300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.003300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.003300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.003300] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.003300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.003551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.003673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.003762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.003851] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.004592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-05cc2d8e-6ff5-4046-8a68-215c985018dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.004690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.004750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.004892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.004959] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cc2d8e-6ff5-4046-8a68-215c985018dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.052808] env[62815]: INFO networking_nsxv3.common.synchronization [None req-be947ad5-db26-489d-9076-7ada3064c988 tempest-ServersTestBootFromVolume-393267422 tempest-ServersTestBootFromVolume-393267422-project-member] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_rules [ 588.053479] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_rules [ 588.054352] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.054352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.080380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d in Status: SUCCESS [ 588.080380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.188402] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.188751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.188751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.188870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.188962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.189073] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b already deleted. [ 588.189157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.189708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.189877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.189966] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.264404] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee37c1c1-598e-48f2-b822-1dae4d87bbb5 [ 588.270282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.270463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.270538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.271133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.271133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.271133] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee37c1c1-598e-48f2-b822-1dae4d87bbb5 already deleted. [ 588.271133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee37c1c1-598e-48f2-b822-1dae4d87bbb5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.509677] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.509928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.510036] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.510995] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05cc2d8e-6ff5-4046-8a68-215c985018dd with status ACTIVE [ 588.511206] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.515022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.515022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.515022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.515022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05cc2d8e-6ff5-4046-8a68-215c985018dd is going to be updated. [ 588.541883] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.541883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.541883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.541883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.542154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.542154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05cc2d8e-6ff5-4046-8a68-215c985018dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.713817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.714109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 588.714200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.714429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 588.714659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 588.714780] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b already deleted. [ 588.714968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.019083] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.249800] env[62815]: INFO networking_nsxv3.common.synchronization [None req-3ea165c7-f163-4e5b-962f-025b735bb83b None None] Enqueued Resource ID: bb3c0f0f-e4b3-46be-b629-f84ff8f43f96 with Priority: HIGHEST for action port [ 589.250087] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3c0f0f-e4b3-46be-b629-f84ff8f43f96 with Priority: HIGHEST for action port [ 589.250711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb3c0f0f-e4b3-46be-b629-f84ff8f43f96 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.250797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb3c0f0f-e4b3-46be-b629-f84ff8f43f96" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.250858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb3c0f0f-e4b3-46be-b629-f84ff8f43f96" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.252161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb3c0f0f-e4b3-46be-b629-f84ff8f43f96" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.252161] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb3c0f0f-e4b3-46be-b629-f84ff8f43f96',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.525140] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.525140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.525140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.528991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.528991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.528991] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 is going to be created. [ 589.553358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.553358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.553358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.553532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.554061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.566192] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 in Status: UNINITIALIZED for 2s [ 589.753984] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb3c0f0f-e4b3-46be-b629-f84ff8f43f96 [ 589.754298] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.754454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 589.754995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.755320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 589.755936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 589.755936] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb3c0f0f-e4b3-46be-b629-f84ff8f43f96 already deleted. [ 589.755936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb3c0f0f-e4b3-46be-b629-f84ff8f43f96" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.368956] env[62815]: INFO networking_nsxv3.common.synchronization [None req-40d71a6e-7cd2-4307-9ecd-e98c654566a3 None None] Enqueued Resource ID: 3ab901db-63c6-4f8a-8c09-1a9f561d7ec2 with Priority: HIGHEST for action port [ 590.369500] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab901db-63c6-4f8a-8c09-1a9f561d7ec2 with Priority: HIGHEST for action port [ 590.369812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab901db-63c6-4f8a-8c09-1a9f561d7ec2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.370029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab901db-63c6-4f8a-8c09-1a9f561d7ec2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.370029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab901db-63c6-4f8a-8c09-1a9f561d7ec2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.370559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab901db-63c6-4f8a-8c09-1a9f561d7ec2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.370749] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab901db-63c6-4f8a-8c09-1a9f561d7ec2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.874635] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ab901db-63c6-4f8a-8c09-1a9f561d7ec2 [ 590.874859] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.874999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 590.875083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.875296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 590.875391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 590.875481] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ab901db-63c6-4f8a-8c09-1a9f561d7ec2 already deleted. [ 590.875618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab901db-63c6-4f8a-8c09-1a9f561d7ec2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.581872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 in Status: SUCCESS [ 591.583970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.584575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.585118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.586429] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.586429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.586429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.586429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.586429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.586429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 591.586429] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.969044] env[62815]: INFO networking_nsxv3.common.synchronization [None req-19608a14-5660-45c2-8517-898c7a0fe908 None None] Enqueued Resource ID: 044e52f5-a1ab-4fab-9396-babf1d618705 with Priority: HIGHEST for action port [ 591.971130] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044e52f5-a1ab-4fab-9396-babf1d618705 with Priority: HIGHEST for action port [ 591.971130] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-044e52f5-a1ab-4fab-9396-babf1d618705 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.971130] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-044e52f5-a1ab-4fab-9396-babf1d618705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 591.971130] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-044e52f5-a1ab-4fab-9396-babf1d618705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.972291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-044e52f5-a1ab-4fab-9396-babf1d618705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 591.972291] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('044e52f5-a1ab-4fab-9396-babf1d618705',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.089496] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.454708] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5358e239-529c-4633-94d1-ced240a79a95 None None] Enqueued Resource ID: 32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f with Priority: HIGHEST for action port [ 592.456861] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f with Priority: HIGHEST for action port [ 592.456861] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.456861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.456861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.456861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.456861] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.474853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 044e52f5-a1ab-4fab-9396-babf1d618705 [ 592.476033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.476033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.476033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.476033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.476033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.476033] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:044e52f5-a1ab-4fab-9396-babf1d618705 already deleted. [ 592.476033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-044e52f5-a1ab-4fab-9396-babf1d618705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.549376] env[62815]: INFO networking_nsxv3.common.synchronization [req-e37463de-7511-47aa-aabf-49dd3d330787 req-912bbbfb-555a-4402-96e3-9c3df69e4ea7 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 592.550217] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 592.550539] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.550661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.550876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.551015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.551731] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.552299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.552443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.553191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.553385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.553809] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.593585] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df11bad1-7d19-47ba-9b6a-8f12d59d5612: rpc.has_security_group_logging(os_id): False [ 592.612770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.612770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.612770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.612770] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 is going to be created. [ 592.668632] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.668878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.668878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.669147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.669329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.683273] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 in Status: IN_PROGRESS for 2s [ 592.961286] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f [ 592.961286] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.961286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 592.961286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.961286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 592.961286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 592.961286] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f already deleted. [ 592.961286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32b1f340-fd44-4fdc-a7c8-fa10d4c4f56f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.058798] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.059683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.059683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.059683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.059683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.059683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.059683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.060279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.060279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.060279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.060279] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 already deleted. [ 593.060279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.343531] env[62815]: INFO networking_nsxv3.common.synchronization [None req-59a52324-9f95-4dcc-8ef2-2d5fbb27dd18 None None] Enqueued Resource ID: 4607add3-5abc-4498-bd35-e5e854dfdd47 with Priority: HIGHEST for action port [ 593.343531] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4607add3-5abc-4498-bd35-e5e854dfdd47 with Priority: HIGHEST for action port [ 593.343531] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4607add3-5abc-4498-bd35-e5e854dfdd47 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.343531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4607add3-5abc-4498-bd35-e5e854dfdd47" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.344112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4607add3-5abc-4498-bd35-e5e854dfdd47" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.344466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4607add3-5abc-4498-bd35-e5e854dfdd47" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.344663] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4607add3-5abc-4498-bd35-e5e854dfdd47',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.566667] env[62815]: INFO networking_nsxv3.common.synchronization [req-9fe35d87-d441-471a-be3d-ce48d36cf8d2 req-855a3d69-7dc0-47cb-9378-63012f4530f3 tempest-ServerExternalEventsTest-930270806 tempest-ServerExternalEventsTest-930270806-project-member] Enqueued Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_members [ 593.567480] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 with Priority: HIGHEST for action security_group_members [ 593.567648] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2f3140d-d06d-40e7-9719-ba1446ff3270 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.567772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.567837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.569474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.569730] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.569868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.569943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.570221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.570319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.570422] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2f3140d-d06d-40e7-9719-ba1446ff3270',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.851145] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4607add3-5abc-4498-bd35-e5e854dfdd47 [ 593.851145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.851145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.851145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.851753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.851753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.851753] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4607add3-5abc-4498-bd35-e5e854dfdd47 already deleted. [ 593.851753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4607add3-5abc-4498-bd35-e5e854dfdd47" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.922063] env[62815]: INFO networking_nsxv3.common.synchronization [req-62bfb226-481b-4ee8-9ee3-27b14e181d54 req-fe094645-343d-4506-858e-57e80f5b0ff7 tempest-TenantUsagesTestJSON-1054573724 tempest-TenantUsagesTestJSON-1054573724-project-member] Enqueued Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_members [ 593.922722] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGHEST for action security_group_members [ 593.922916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.923055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.923119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.923392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.923522] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.923625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 593.923682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.923940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 593.923940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 593.924048] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.074189] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.074189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.074189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.074189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.074189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.074189] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.074189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.074189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.074647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.074647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.074647] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 is going to be updated. [ 594.106711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.106711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.106711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.106711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.106711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.113118] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 in Status: IN_PROGRESS for 2s [ 594.191268] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.191268] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.191268] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.191486] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.191777] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.191998] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.198025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.198025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.198025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.198025] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.198025] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.198025] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.198025] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.198025] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.198025] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.198025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.214971] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.214971] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 594.214971] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.215149] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.215446] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-d5aaec46-5ba7-4781-b754-c8e4de114317 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.215630] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.215784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.216129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.216275] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5aaec46-5ba7-4781-b754-c8e4de114317',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.427022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.427929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.428383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.431084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.431198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.431507] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.431618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.431618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.431775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.431931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.431931] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 is going to be updated. [ 594.459807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.460041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.460093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.460265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.460404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.473159] env[62815]: INFO networking_nsxv3.common.synchronization [None req-7c1f99b2-020b-4acc-b573-5b237843c21d None None] Enqueued Resource ID: 265ed5d1-c545-4181-abf4-34e9579e8a41 with Priority: HIGHEST for action port [ 594.473159] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 265ed5d1-c545-4181-abf4-34e9579e8a41 with Priority: HIGHEST for action port [ 594.473159] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-265ed5d1-c545-4181-abf4-34e9579e8a41 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.473159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-265ed5d1-c545-4181-abf4-34e9579e8a41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.473159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-265ed5d1-c545-4181-abf4-34e9579e8a41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.473159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-265ed5d1-c545-4181-abf4-34e9579e8a41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.473159] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('265ed5d1-c545-4181-abf4-34e9579e8a41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.474853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 in Status: IN_PROGRESS for 2s [ 594.699333] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 in Status: SUCCESS [ 594.701224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.722135] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.725572] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port d5aaec46-5ba7-4781-b754-c8e4de114317 not found, creating... [ 594.725572] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.725572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.725927] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.727775] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.728323] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.728323] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.728437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.732029] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: d5aaec46-5ba7-4781-b754-c8e4de114317 is going to be created. [ 594.758473] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.758576] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.758915] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.759104] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.759341] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.759700] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.894198] env[62815]: INFO networking_nsxv3.common.synchronization [req-0577635e-93b0-4714-b090-ddb9741064e0 req-74526718-e059-4b5e-99b9-3709f99de524 tempest-ServersWithSpecificFlavorTestJSON-887013430 tempest-ServersWithSpecificFlavorTestJSON-887013430-project-member] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 594.894198] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 594.894198] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.894198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.894198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.898378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.898378] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.898378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.898378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.898378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.898378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.898378] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.976732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 265ed5d1-c545-4181-abf4-34e9579e8a41 [ 594.976966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.977120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 594.977196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.977415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 594.977661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 594.977661] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:265ed5d1-c545-4181-abf4-34e9579e8a41 already deleted. [ 594.977661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-265ed5d1-c545-4181-abf4-34e9579e8a41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.401424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.401424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.401424] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 already deleted. [ 595.401424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.722384] env[62815]: INFO networking_nsxv3.common.synchronization [req-e37463de-7511-47aa-aabf-49dd3d330787 req-07a947c5-2a1a-4b35-9f10-42b33cbbc351 service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 595.722571] env[62815]: INFO networking_nsxv3.common.synchronization [req-e37463de-7511-47aa-aabf-49dd3d330787 req-07a947c5-2a1a-4b35-9f10-42b33cbbc351 service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 595.722713] env[62815]: INFO networking_nsxv3.common.synchronization [req-e37463de-7511-47aa-aabf-49dd3d330787 req-07a947c5-2a1a-4b35-9f10-42b33cbbc351 service nova] Enqueued Resource ID: d5aaec46-5ba7-4781-b754-c8e4de114317 with Priority: HIGHEST for action port [ 595.722946] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 595.723129] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 595.723183] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5aaec46-5ba7-4781-b754-c8e4de114317 with Priority: HIGHEST for action port [ 595.723752] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.723879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.724278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.725486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.725580] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.726480] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.726588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.726635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.726822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.726975] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.727087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.727202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.727298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.727389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 595.727474] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.728810] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5aaec46-5ba7-4781-b754-c8e4de114317 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.728925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 595.728994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.729176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 595.729253] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5aaec46-5ba7-4781-b754-c8e4de114317',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.002897] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.003160] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.003160] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.003408] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.003726] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.003793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.003911] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.004430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.004628] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.005829] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 596.005829] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.005829] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.005829] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.005829] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 596.005829] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.005829] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.026213] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.026213] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 596.026213] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.026213] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.026213] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-cca6a4f8-6bb6-42fa-8f06-1c396e400946 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.026213] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.026213] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.026213] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.026213] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca6a4f8-6bb6-42fa-8f06-1c396e400946',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.124123] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 in Status: SUCCESS [ 596.124413] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2f3140d-d06d-40e7-9719-ba1446ff3270 deletion is rescheduled due to dependency. [ 596.124413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2f3140d-d06d-40e7-9719-ba1446ff3270" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.233402] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.235690] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.235821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.236042] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5aaec46-5ba7-4781-b754-c8e4de114317 with status ACTIVE [ 596.236211] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.236320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.236385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.236621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.236831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.236893] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.236986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.237689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.237689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.237689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.237689] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.237857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.237857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.237924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.237998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.238094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5aaec46-5ba7-4781-b754-c8e4de114317 is going to be updated. [ 596.259910] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.260079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.260079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.260231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.261317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.261317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5aaec46-5ba7-4781-b754-c8e4de114317" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.484014] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 in Status: SUCCESS [ 596.484205] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 deletion is rescheduled due to dependency. [ 596.484325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.532955] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.532955] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port cca6a4f8-6bb6-42fa-8f06-1c396e400946 not found, creating... [ 596.532955] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.532955] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.533587] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.533587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.533587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.533587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.535504] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.535740] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: cca6a4f8-6bb6-42fa-8f06-1c396e400946 is going to be created. [ 596.556228] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.556546] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.556691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.557059] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.557378] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.557654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 596.741670] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.917446] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e5ace356-ab0d-4382-a3f5-fc00ed5c9d1c None None] Enqueued Resource ID: 960a9f8b-72ca-4d41-9778-906b42e7d6aa with Priority: HIGHEST for action port [ 596.918380] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960a9f8b-72ca-4d41-9778-906b42e7d6aa with Priority: HIGHEST for action port [ 596.918825] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-960a9f8b-72ca-4d41-9778-906b42e7d6aa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.919321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-960a9f8b-72ca-4d41-9778-906b42e7d6aa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 596.919429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-960a9f8b-72ca-4d41-9778-906b42e7d6aa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.919700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-960a9f8b-72ca-4d41-9778-906b42e7d6aa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 596.919785] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960a9f8b-72ca-4d41-9778-906b42e7d6aa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.209270] env[62815]: INFO networking_nsxv3.common.synchronization [req-0aabb3db-40c4-4fef-8183-620b89673a98 req-3d2cd852-4336-4f01-9e43-a2334c919904 tempest-ServerMetadataNegativeTestJSON-1515027532 tempest-ServerMetadataNegativeTestJSON-1515027532-project-member] Enqueued Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_members [ 597.209965] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_members [ 597.210395] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.210664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.210740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.211102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.211266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.211364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.211426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.211577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.212262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.212484] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.247038] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.247852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.248096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.249034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.249034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.249034] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be created. [ 597.273658] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.273658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.273658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.275266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.275266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.278158] env[62815]: INFO networking_nsxv3.common.synchronization [None req-fb46090d-0ad1-45a9-9b50-d16dc82bd5c2 None None] Enqueued Resource ID: 5ff2993c-f523-45c3-b1eb-2825469b5ea2 with Priority: HIGHEST for action port [ 597.278772] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff2993c-f523-45c3-b1eb-2825469b5ea2 with Priority: HIGHEST for action port [ 597.279417] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff2993c-f523-45c3-b1eb-2825469b5ea2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.279668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff2993c-f523-45c3-b1eb-2825469b5ea2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.279755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff2993c-f523-45c3-b1eb-2825469b5ea2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.280678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff2993c-f523-45c3-b1eb-2825469b5ea2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.280811] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff2993c-f523-45c3-b1eb-2825469b5ea2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.287975] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: UNINITIALIZED for 2s [ 597.424105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 960a9f8b-72ca-4d41-9778-906b42e7d6aa [ 597.424105] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.424105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.424105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.424105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.424105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.424105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:960a9f8b-72ca-4d41-9778-906b42e7d6aa already deleted. [ 597.424105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-960a9f8b-72ca-4d41-9778-906b42e7d6aa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.714493] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.714662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.714721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.715669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.716875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.717200] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.717326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.717386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.718476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.718476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.718476] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a already deleted. [ 597.718476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.761440] env[62815]: INFO networking_nsxv3.common.synchronization [None req-8fee516d-b17b-4652-9ec8-aed1b0de0781 None None] Enqueued Resource ID: 9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd with Priority: HIGHEST for action port [ 597.762130] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd with Priority: HIGHEST for action port [ 597.763032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.763032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.763032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.763032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.763299] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.783950] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ff2993c-f523-45c3-b1eb-2825469b5ea2 [ 597.783950] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.783950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.783950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.783950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.783950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.783950] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ff2993c-f523-45c3-b1eb-2825469b5ea2 already deleted. [ 597.783950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff2993c-f523-45c3-b1eb-2825469b5ea2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.917114] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.918488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-258" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.918616] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-258" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.919306] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-258" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.919712] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.919896] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.920026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.920314] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.920841] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.921466] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 597.921567] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.921623] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.921928] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.922892] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 597.922892] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.922892] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.940274] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.940326] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 597.940447] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.941535] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-258" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.941535] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-4178a8fd-9861-4cc2-ad42-b347cde06968 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.941535] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.941535] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.941535] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.941799] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4178a8fd-9861-4cc2-ad42-b347cde06968',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.982117] env[62815]: INFO networking_nsxv3.common.synchronization [req-0577635e-93b0-4714-b090-ddb9741064e0 req-c3608bb9-b1c4-421b-bf4f-6109b95c8941 service nova] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 597.982117] env[62815]: INFO networking_nsxv3.common.synchronization [req-0577635e-93b0-4714-b090-ddb9741064e0 req-c3608bb9-b1c4-421b-bf4f-6109b95c8941 service nova] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 597.982117] env[62815]: INFO networking_nsxv3.common.synchronization [req-0577635e-93b0-4714-b090-ddb9741064e0 req-c3608bb9-b1c4-421b-bf4f-6109b95c8941 service nova] Enqueued Resource ID: cca6a4f8-6bb6-42fa-8f06-1c396e400946 with Priority: HIGHEST for action port [ 597.982117] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 597.982117] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 597.982117] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca6a4f8-6bb6-42fa-8f06-1c396e400946 with Priority: HIGHEST for action port [ 597.982117] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.982117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.982117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.982117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.982117] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.982586] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.982586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.982586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.982696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.982769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.982867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.982925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.983081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.983174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 597.983245] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.988017] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-cca6a4f8-6bb6-42fa-8f06-1c396e400946 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.988017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 597.988017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.988017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 597.988017] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cca6a4f8-6bb6-42fa-8f06-1c396e400946',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.022701] env[62815]: INFO networking_nsxv3.common.synchronization [req-0e61bdeb-6c14-406a-9660-ba7ef3d458a1 req-e8929b74-9e1c-4d41-8eef-c5256aeb9365 tempest-ServerDiagnosticsTest-1072401595 tempest-ServerDiagnosticsTest-1072401595-project-member] Enqueued Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_members [ 598.023579] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGHEST for action security_group_members [ 598.026049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.026049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.026049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.026049] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.266260] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd [ 598.266652] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.269105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.269253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.269487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.269587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.269705] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd already deleted. [ 598.269791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b563d37-3c3e-4f5d-b9eb-04d5ec0f4edd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.444792] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.445045] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.445180] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.445469] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.445625] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.448211] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 4178a8fd-9861-4cc2-ad42-b347cde06968 not found, creating... [ 598.448211] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.448211] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.448211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.448765] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.448765] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 4178a8fd-9861-4cc2-ad42-b347cde06968 is going to be created. [ 598.488731] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.488977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.489195] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.490774] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cca6a4f8-6bb6-42fa-8f06-1c396e400946 with status ACTIVE [ 598.491491] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.491491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.491491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.491491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.491676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.491762] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.491814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.491977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.492081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.492081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.492278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.492366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.492425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.492535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.492913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.492913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cca6a4f8-6bb6-42fa-8f06-1c396e400946 is going to be updated. [ 598.530227] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.530385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.530462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.530881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.530881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.530997] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.531125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.531179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.531306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.531385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.531477] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 is going to be updated. [ 598.540768] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.540966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.540966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.541232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.542485] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.542485] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.543052] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.543180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.543253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.543412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.543524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.543699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cca6a4f8-6bb6-42fa-8f06-1c396e400946" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.564039] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.564317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 598.564317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.564389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 598.564459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 598.571999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 in Status: IN_PROGRESS for 2s [ 598.994485] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.298081] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 599.298423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.298507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.298819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.300099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.300099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.300099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.300506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.300982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.300982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.300982] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.497491] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.497661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.497746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.498554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.498554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.498554] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be created. [ 599.523273] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.523409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.523476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.523819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.533072] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: UNINITIALIZED for 2s [ 599.673352] env[62815]: INFO networking_nsxv3.common.synchronization [req-0aabb3db-40c4-4fef-8183-620b89673a98 req-078f64c8-1685-4b87-ac2e-031d8d7768b4 service nova] Enqueued Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_rules [ 599.674247] env[62815]: INFO networking_nsxv3.common.synchronization [req-0aabb3db-40c4-4fef-8183-620b89673a98 req-078f64c8-1685-4b87-ac2e-031d8d7768b4 service nova] Enqueued Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_members [ 599.674247] env[62815]: INFO networking_nsxv3.common.synchronization [req-0aabb3db-40c4-4fef-8183-620b89673a98 req-078f64c8-1685-4b87-ac2e-031d8d7768b4 service nova] Enqueued Resource ID: 4178a8fd-9861-4cc2-ad42-b347cde06968 with Priority: HIGHEST for action port [ 599.674409] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_rules [ 599.674558] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_members [ 599.674664] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4178a8fd-9861-4cc2-ad42-b347cde06968 with Priority: HIGHEST for action port [ 599.675230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.675230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.675230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.675778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.675778] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.677201] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.677201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.677201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.677353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.677428] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.677497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.677556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.677696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.677780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.677867] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.678890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4178a8fd-9861-4cc2-ad42-b347cde06968 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.678890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.678890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.679077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.679144] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4178a8fd-9861-4cc2-ad42-b347cde06968',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.803742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.804026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.804026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.804668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.804668] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.804668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.804668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.804918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.804918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.804918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.806120] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.806120] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.806120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 599.806120] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.001852] env[62815]: INFO networking_nsxv3.common.synchronization [None req-ab783030-3a31-4489-86be-c14ad304b668 None None] Enqueued Resource ID: de8900cb-b574-428c-94fa-a67c436ceca3 with Priority: HIGHEST for action port [ 600.003979] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8900cb-b574-428c-94fa-a67c436ceca3 with Priority: HIGHEST for action port [ 600.003979] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-de8900cb-b574-428c-94fa-a67c436ceca3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.003979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de8900cb-b574-428c-94fa-a67c436ceca3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.003979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de8900cb-b574-428c-94fa-a67c436ceca3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.003979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de8900cb-b574-428c-94fa-a67c436ceca3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.003979] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de8900cb-b574-428c-94fa-a67c436ceca3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.181148] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.181311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.181533] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.183258] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4178a8fd-9861-4cc2-ad42-b347cde06968 with status ACTIVE [ 600.184436] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.184436] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.184436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.184836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.184958] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.185134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.185261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.185427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.185542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.185661] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4178a8fd-9861-4cc2-ad42-b347cde06968 is going to be updated. [ 600.207321] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.207496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.207565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.210278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.210278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.210278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4178a8fd-9861-4cc2-ad42-b347cde06968" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.312389] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 600.332212] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.332365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.332412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.332624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.332719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.332903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.332996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.333067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.333233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.333346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.333539] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.333634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.333689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.333829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.333904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.334102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.334364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.334364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.334364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.334504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.334540] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be created. [ 600.401798] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.401798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.401798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.401798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.401798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.411640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 600.456987] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9258bccf-4e27-48dc-b590-5684cb56cdcc tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 600.460923] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 600.460923] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.460923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.460923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.460923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.460923] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.506681] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de8900cb-b574-428c-94fa-a67c436ceca3 [ 600.506681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.506681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.506681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.506681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.506681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.506681] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de8900cb-b574-428c-94fa-a67c436ceca3 already deleted. [ 600.506681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de8900cb-b574-428c-94fa-a67c436ceca3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.590115] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 in Status: SUCCESS [ 600.595036] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 deletion is rescheduled due to dependency. [ 600.595036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.688665] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.827126] env[62815]: INFO networking_nsxv3.common.synchronization [None req-94cf2485-ef8f-4aad-ad62-bd4ef8e2b63b tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 600.827126] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 600.827126] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.827126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.980961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.980961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 600.980961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.980961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.980961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.981238] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 already deleted. [ 600.981238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 600.981325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.981494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 600.981593] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.195163] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.195163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.195163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.195163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.195163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.195163] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a is going to be created. [ 601.219278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.219418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.219486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.219813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.219867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.229554] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a in Status: UNINITIALIZED for 2s [ 601.501878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.503105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.503302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.503592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.503776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.503943] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 already deleted. [ 601.504117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.545030] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.545030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.545030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 601.545030] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.047454] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.423891] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 602.423891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.551210] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a360f68-c409-4d28-9396-e41a05128638: rpc.has_security_group_logging(os_id): False [ 602.569465] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.569465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.569465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.570863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.570863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.570863] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.570863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.570863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.570863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.570863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.570863] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be created. [ 602.633089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.633089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 602.633089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.633089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 602.633089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 602.641712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 603.091858] env[62815]: INFO networking_nsxv3.common.synchronization [None req-42f7e26e-1797-4d63-b043-40e786b1d748 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 603.092558] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 603.092810] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.093017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.093017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.099025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.099025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.114248] env[62815]: INFO networking_nsxv3.common.synchronization [None req-4719d30b-2c58-44e6-8be3-70e2a3e6bc53 None None] Enqueued Resource ID: 038280d1-08e6-4d89-9952-975d00e11cc1 with Priority: HIGHEST for action port [ 603.114507] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 038280d1-08e6-4d89-9952-975d00e11cc1 with Priority: HIGHEST for action port [ 603.115092] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-038280d1-08e6-4d89-9952-975d00e11cc1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.115220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-038280d1-08e6-4d89-9952-975d00e11cc1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.115286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-038280d1-08e6-4d89-9952-975d00e11cc1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.115571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-038280d1-08e6-4d89-9952-975d00e11cc1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.115725] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('038280d1-08e6-4d89-9952-975d00e11cc1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.240095] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a in Status: SUCCESS [ 603.240333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.240577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.240793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.240999] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.241128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.241190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.241342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.241422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.241511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.241607] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.269212] env[62815]: INFO networking_nsxv3.common.synchronization [None req-617f3767-e8ed-4a94-b9b4-ef2a9df5a024 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 603.269699] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 603.270031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.270146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.618835] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 038280d1-08e6-4d89-9952-975d00e11cc1 [ 603.619122] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.619231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.619296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.619512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.619705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.619794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:038280d1-08e6-4d89-9952-975d00e11cc1 already deleted. [ 603.619986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-038280d1-08e6-4d89-9952-975d00e11cc1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.623829] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.627116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.627287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.627558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.627696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.627783] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 already deleted. [ 603.627871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.628065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.628251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.628338] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.744475] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.744718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.744718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.744913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.745439] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.745439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.745439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.745735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.746077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.746077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.746248] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.746411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.746676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.746831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.748569] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.748569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.748569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.748569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.748569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.748569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 603.748569] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.835702] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9969a846-b98f-4be7-96e9-2586a132726d None None] Enqueued Resource ID: 50884789-3a5b-43c3-afd5-358c8f2f05b8 with Priority: HIGHEST for action port [ 603.835702] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50884789-3a5b-43c3-afd5-358c8f2f05b8 with Priority: HIGHEST for action port [ 603.836849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-50884789-3a5b-43c3-afd5-358c8f2f05b8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.837220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50884789-3a5b-43c3-afd5-358c8f2f05b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 603.838911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50884789-3a5b-43c3-afd5-358c8f2f05b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.840552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50884789-3a5b-43c3-afd5-358c8f2f05b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 603.841586] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50884789-3a5b-43c3-afd5-358c8f2f05b8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.159020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.159020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.159020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.159464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.159599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.159952] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 already deleted. [ 604.161170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.177173] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e612e962-aa48-4036-8fdf-5b504bc9cf00 None None] Enqueued Resource ID: 6d79e06a-ab9f-4583-a71f-912640fe8259 with Priority: HIGHEST for action port [ 604.181196] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d79e06a-ab9f-4583-a71f-912640fe8259 with Priority: HIGHEST for action port [ 604.183479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d79e06a-ab9f-4583-a71f-912640fe8259 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.183479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d79e06a-ab9f-4583-a71f-912640fe8259" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.183479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d79e06a-ab9f-4583-a71f-912640fe8259" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.183479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d79e06a-ab9f-4583-a71f-912640fe8259" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.183479] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d79e06a-ab9f-4583-a71f-912640fe8259',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.254721] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a: rpc.has_security_group_logging(os_id): False [ 604.270730] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.270730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.270730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.270730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.270730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.271329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.271625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.271930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.273647] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.273647] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.273647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.274366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.274595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.274804] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a is going to be created. [ 604.330069] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.330069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.330069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.330069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.330398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.344197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a in Status: IN_PROGRESS for 2s [ 604.346367] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50884789-3a5b-43c3-afd5-358c8f2f05b8 [ 604.346517] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.346690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.346772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.347185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.347442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.347520] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50884789-3a5b-43c3-afd5-358c8f2f05b8 already deleted. [ 604.347578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50884789-3a5b-43c3-afd5-358c8f2f05b8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.655293] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 604.655293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.690890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d79e06a-ab9f-4583-a71f-912640fe8259 [ 604.690890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.690890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 604.690890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.690890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 604.690890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 604.690890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d79e06a-ab9f-4583-a71f-912640fe8259 already deleted. [ 604.690890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d79e06a-ab9f-4583-a71f-912640fe8259" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.358430] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a in Status: SUCCESS [ 606.358430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 606.607461] env[62815]: INFO networking_nsxv3.common.synchronization [None req-6fb24fb6-3d99-44ea-8604-23cfe1dca852 None None] Enqueued Resource ID: 169582d8-2602-40d8-8bc0-f37da338e269 with Priority: HIGHEST for action port [ 606.608767] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 169582d8-2602-40d8-8bc0-f37da338e269 with Priority: HIGHEST for action port [ 606.610074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-169582d8-2602-40d8-8bc0-f37da338e269 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.610074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-169582d8-2602-40d8-8bc0-f37da338e269" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 606.610265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-169582d8-2602-40d8-8bc0-f37da338e269" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.610488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-169582d8-2602-40d8-8bc0-f37da338e269" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 606.610658] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169582d8-2602-40d8-8bc0-f37da338e269',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.113480] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 169582d8-2602-40d8-8bc0-f37da338e269 [ 607.113729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.113864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.113934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.114177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.114305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.114403] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:169582d8-2602-40d8-8bc0-f37da338e269 already deleted. [ 607.114485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-169582d8-2602-40d8-8bc0-f37da338e269" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.605031] env[62815]: INFO networking_nsxv3.common.synchronization [req-f190d654-738a-4048-962e-558e02a3e275 req-ce48db66-051c-488a-baa9-cecd996ab28f tempest-ListImageFiltersTestJSON-1830437384 tempest-ListImageFiltersTestJSON-1830437384-project-member] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 607.605031] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 607.605031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.605031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.605031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.606412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.606412] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.606412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.606412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.606412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.606412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 607.606412] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.957163] env[62815]: INFO networking_nsxv3.common.synchronization [None req-8cad3247-566e-4070-b1c6-7420273617d9 None None] Enqueued Resource ID: 8e7723df-5dec-482e-a5c9-097c39949931 with Priority: HIGHEST for action port [ 607.957163] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e7723df-5dec-482e-a5c9-097c39949931 with Priority: HIGHEST for action port [ 607.957163] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e7723df-5dec-482e-a5c9-097c39949931 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.957163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e7723df-5dec-482e-a5c9-097c39949931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 607.957163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e7723df-5dec-482e-a5c9-097c39949931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.957163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e7723df-5dec-482e-a5c9-097c39949931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 607.957163] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e7723df-5dec-482e-a5c9-097c39949931',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.108755] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.108973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.109147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.109296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.109443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.109588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.109722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.109767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.109927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.110036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.110112] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 already deleted. [ 608.110191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.396497] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.397080] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.397262] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.397602] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.397931] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.399142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.399142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.399142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.400421] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.400851] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 608.401035] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.401202] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.401341] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.401485] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 608.401621] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.401787] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.432313] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.432313] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 608.432313] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.432313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.432313] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-654afe23-5f44-4fb8-8610-d9198776c9d3 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.432313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.432313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.432313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.432313] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654afe23-5f44-4fb8-8610-d9198776c9d3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.458665] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e7723df-5dec-482e-a5c9-097c39949931 [ 608.458665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.459105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.459105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.459105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.459224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.459224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e7723df-5dec-482e-a5c9-097c39949931 already deleted. [ 608.459809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e7723df-5dec-482e-a5c9-097c39949931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.934781] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.935253] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.935253] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.935905] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.936895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.937125] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 654afe23-5f44-4fb8-8610-d9198776c9d3 not found, creating... [ 608.937427] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.937611] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.937731] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.938049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.939251] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.939601] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.939803] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.939951] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.940207] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.940372] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.940501] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 654afe23-5f44-4fb8-8610-d9198776c9d3 is going to be created. [ 608.963537] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.964182] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 608.964182] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.964304] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 608.965035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 608.966069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.007234] env[62815]: INFO networking_nsxv3.common.synchronization [req-f190d654-738a-4048-962e-558e02a3e275 req-376fa712-f7a5-48a7-bedd-236be88d51bb service nova] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_rules [ 610.007489] env[62815]: INFO networking_nsxv3.common.synchronization [req-f190d654-738a-4048-962e-558e02a3e275 req-376fa712-f7a5-48a7-bedd-236be88d51bb service nova] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 610.007534] env[62815]: INFO networking_nsxv3.common.synchronization [req-f190d654-738a-4048-962e-558e02a3e275 req-376fa712-f7a5-48a7-bedd-236be88d51bb service nova] Enqueued Resource ID: 654afe23-5f44-4fb8-8610-d9198776c9d3 with Priority: HIGHEST for action port [ 610.010035] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_rules [ 610.010035] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 610.010035] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654afe23-5f44-4fb8-8610-d9198776c9d3 with Priority: HIGHEST for action port [ 610.010035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.010035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.010035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.010035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.010035] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.010542] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.010542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.010542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.010542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.010799] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.012034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.012034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.012034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.012034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.012034] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.021081] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-654afe23-5f44-4fb8-8610-d9198776c9d3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.021081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.021081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.021081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.021081] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654afe23-5f44-4fb8-8610-d9198776c9d3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.210891] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c2311b79-11a9-4698-bf05-ac8ceb69544d None None] Enqueued Resource ID: 3a122885-9899-4d19-82e6-56f2b8584c92 with Priority: HIGHEST for action port [ 610.210891] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a122885-9899-4d19-82e6-56f2b8584c92 with Priority: HIGHEST for action port [ 610.210891] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a122885-9899-4d19-82e6-56f2b8584c92 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.210891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a122885-9899-4d19-82e6-56f2b8584c92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.210891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a122885-9899-4d19-82e6-56f2b8584c92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.211565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a122885-9899-4d19-82e6-56f2b8584c92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.211565] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a122885-9899-4d19-82e6-56f2b8584c92',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.491124] env[62815]: INFO networking_nsxv3.common.synchronization [req-d4b05f9c-61a3-42b5-8cf8-cb2c2d8fad9e req-4b10c7f3-b0e0-4c94-bfb0-5e03b80647ea tempest-ListImageFiltersTestJSON-1830437384 tempest-ListImageFiltersTestJSON-1830437384-project-member] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 610.491709] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 610.493442] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.494046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.519134] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.519134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.521559] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 654afe23-5f44-4fb8-8610-d9198776c9d3 with status ACTIVE [ 610.523260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.523260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.523260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.523260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.524165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.524165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.524165] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 654afe23-5f44-4fb8-8610-d9198776c9d3 is going to be updated. [ 610.524959] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.547053] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.547053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.547053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.547264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.549604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.549604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-654afe23-5f44-4fb8-8610-d9198776c9d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.569020] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a0d773e3-f25d-4db0-9b21-135d5b2917cc None None] Enqueued Resource ID: 871f3bb2-6d7b-463d-a83c-aaf76642fc4e with Priority: HIGHEST for action port [ 610.569020] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 871f3bb2-6d7b-463d-a83c-aaf76642fc4e with Priority: HIGHEST for action port [ 610.569020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-871f3bb2-6d7b-463d-a83c-aaf76642fc4e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.569020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-871f3bb2-6d7b-463d-a83c-aaf76642fc4e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.569020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-871f3bb2-6d7b-463d-a83c-aaf76642fc4e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.569020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-871f3bb2-6d7b-463d-a83c-aaf76642fc4e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.569020] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('871f3bb2-6d7b-463d-a83c-aaf76642fc4e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.717428] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a122885-9899-4d19-82e6-56f2b8584c92 [ 610.718479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.718698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 610.718796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.719113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 610.719212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 610.719362] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a122885-9899-4d19-82e6-56f2b8584c92 already deleted. [ 610.719598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a122885-9899-4d19-82e6-56f2b8584c92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.028200] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.076712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 871f3bb2-6d7b-463d-a83c-aaf76642fc4e [ 611.076712] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.076712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.076712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.076712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.076712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.076712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:871f3bb2-6d7b-463d-a83c-aaf76642fc4e already deleted. [ 611.076712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-871f3bb2-6d7b-463d-a83c-aaf76642fc4e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.194502] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.194824] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.194979] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.195292] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.196703] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.196885] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.197039] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.197278] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.197422] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.197634] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.197774] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.197885] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.197998] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.198440] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.198440] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.198440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.216799] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.217061] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 611.217838] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.218084] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.218469] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.218723] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.218915] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.219348] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.219544] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.533720] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.533720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.533720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.533720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.533720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.533720] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be created. [ 611.562099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.562269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.562413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.562564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.562741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.571489] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: UNINITIALIZED for 2s [ 611.724540] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.724738] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.724832] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.725174] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.725323] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.725469] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 not found, creating... [ 611.725750] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.726019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.726059] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.726265] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.726416] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.726700] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.726862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.726983] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.729774] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.729774] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.729774] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 is going to be created. [ 611.773826] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.773826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 611.773826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.773826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 611.773826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 611.773826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 612.559844] env[62815]: INFO networking_nsxv3.common.synchronization [req-d4b05f9c-61a3-42b5-8cf8-cb2c2d8fad9e req-6de924eb-dfb3-4d2c-87ef-ac263dc6bfed service nova] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_rules [ 612.560212] env[62815]: INFO networking_nsxv3.common.synchronization [req-d4b05f9c-61a3-42b5-8cf8-cb2c2d8fad9e req-6de924eb-dfb3-4d2c-87ef-ac263dc6bfed service nova] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 612.560212] env[62815]: INFO networking_nsxv3.common.synchronization [req-d4b05f9c-61a3-42b5-8cf8-cb2c2d8fad9e req-6de924eb-dfb3-4d2c-87ef-ac263dc6bfed service nova] Enqueued Resource ID: 979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 with Priority: HIGHEST for action port [ 612.560459] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_rules [ 612.560592] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 612.560694] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 with Priority: HIGHEST for action port [ 612.565330] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.565455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.565656] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.565747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.565911] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.566035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 612.566099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.567694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 612.567694] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.072728] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 with status ACTIVE [ 613.072969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.073148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.073219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.073455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.073548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.073723] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.073830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.073893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.074077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.074153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.074345] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.074436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.074492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.074637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.074704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.074792] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4 is going to be updated. [ 613.095899] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.096016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.096082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.096283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.096444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.096612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979c2df9-fe94-46e6-a7c8-1ec8bb23d0f4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.581336] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 613.581678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.581678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.581898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.582095] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.582206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 613.582287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.582426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 613.582507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 613.582598] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.086701] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.590438] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.094882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.094882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.094882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.094882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.094882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.094882] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be updated. [ 615.125610] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.125610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 615.125610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.125610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 615.125610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 615.139958] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: IN_PROGRESS for 2s [ 616.627804] env[62815]: INFO networking_nsxv3.common.synchronization [req-aa350aed-04c4-47e4-8b9e-ef9effc79b51 req-a00760aa-7f49-4375-bef0-1d670029b7b3 tempest-FloatingIPsAssociationNegativeTestJSON-1722081294 tempest-FloatingIPsAssociationNegativeTestJSON-1722081294-project-member] Enqueued Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_members [ 616.628109] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_members [ 616.629623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.629623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.629623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.629623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.629623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.631118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.631118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.631517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.631517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 616.631604] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.809024] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f2a9e43f-598c-460c-84d4-360f5124a9ef None None] Enqueued Resource ID: beb7855d-2ef5-40ad-8ea9-1a22f0758bbf with Priority: HIGHEST for action port [ 616.809024] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb7855d-2ef5-40ad-8ea9-1a22f0758bbf with Priority: HIGHEST for action port [ 616.809407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-beb7855d-2ef5-40ad-8ea9-1a22f0758bbf taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.809698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-beb7855d-2ef5-40ad-8ea9-1a22f0758bbf" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 616.809907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-beb7855d-2ef5-40ad-8ea9-1a22f0758bbf" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.810521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-beb7855d-2ef5-40ad-8ea9-1a22f0758bbf" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 616.810712] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb7855d-2ef5-40ad-8ea9-1a22f0758bbf',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.137342] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.137522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.139729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.139729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.139729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.139729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.139729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.139729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.139729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.140106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.140106] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 already deleted. [ 617.140106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.151834] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 617.152519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.152519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.152808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.152899] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.153915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.153992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.154178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.154270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.154360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.154458] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.155671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.155865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.156089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.156187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.156255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.156404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.156486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.156626] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.197017] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.197017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-759" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.197017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-759" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.197017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-759" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.197017] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.197348] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.197348] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.197495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.197634] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.197838] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 617.198022] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.198129] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.198237] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.198345] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 617.198450] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.198589] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.231415] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.231578] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 617.231735] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.231951] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-759" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.232304] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-f9ff2051-c932-4a2a-a614-144545ab3573 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.232467] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.232586] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.232921] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.233073] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ff2051-c932-4a2a-a614-144545ab3573',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.313971] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port beb7855d-2ef5-40ad-8ea9-1a22f0758bbf [ 617.314238] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.314379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.314452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.314666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.314758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.314852] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:beb7855d-2ef5-40ad-8ea9-1a22f0758bbf already deleted. [ 617.314933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-beb7855d-2ef5-40ad-8ea9-1a22f0758bbf" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.660143] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.661488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.661488] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.737113] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.737352] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.737479] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.737897] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.738094] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.738311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port f9ff2051-c932-4a2a-a614-144545ab3573 not found, creating... [ 617.738625] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.738802] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.738988] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.739259] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.739386] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.739669] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.743759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.743759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.744833] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.744833] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.745050] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: f9ff2051-c932-4a2a-a614-144545ab3573 is going to be created. [ 617.776376] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.776376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 617.776376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.776376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 617.776376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 617.776376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.164488] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.669037] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.670677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.670677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.670677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.670677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.670677] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be updated. [ 618.701196] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.701351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 618.701484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.701867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 618.701867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 618.712877] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: IN_PROGRESS for 2s [ 619.043691] env[62815]: INFO networking_nsxv3.common.synchronization [None req-11154866-972d-4725-829e-a03a832dc000 None None] Enqueued Resource ID: 1e35c154-0435-4483-9e36-6b5b0743a355 with Priority: HIGHEST for action port [ 619.043982] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e35c154-0435-4483-9e36-6b5b0743a355 with Priority: HIGHEST for action port [ 619.044565] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e35c154-0435-4483-9e36-6b5b0743a355 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.044717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e35c154-0435-4483-9e36-6b5b0743a355" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.044789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e35c154-0435-4483-9e36-6b5b0743a355" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.046696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e35c154-0435-4483-9e36-6b5b0743a355" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.046871] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e35c154-0435-4483-9e36-6b5b0743a355',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.261203] env[62815]: INFO networking_nsxv3.common.synchronization [req-aa350aed-04c4-47e4-8b9e-ef9effc79b51 req-0a27d27d-b191-493f-be9e-fe36ba7b082c service nova] Enqueued Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_rules [ 619.261604] env[62815]: INFO networking_nsxv3.common.synchronization [req-aa350aed-04c4-47e4-8b9e-ef9effc79b51 req-0a27d27d-b191-493f-be9e-fe36ba7b082c service nova] Enqueued Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_members [ 619.261604] env[62815]: INFO networking_nsxv3.common.synchronization [req-aa350aed-04c4-47e4-8b9e-ef9effc79b51 req-0a27d27d-b191-493f-be9e-fe36ba7b082c service nova] Enqueued Resource ID: f9ff2051-c932-4a2a-a614-144545ab3573 with Priority: HIGHEST for action port [ 619.263080] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_rules [ 619.263354] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_members [ 619.263354] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ff2051-c932-4a2a-a614-144545ab3573 with Priority: HIGHEST for action port [ 619.263623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.263747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.263807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.264084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.264334] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.265948] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.266094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.266207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.266339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.267079] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.267215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.267278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.268660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.268660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.268660] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.268660] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ff2051-c932-4a2a-a614-144545ab3573 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.268660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.268865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.269017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.269017] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ff2051-c932-4a2a-a614-144545ab3573',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.358285] env[62815]: INFO networking_nsxv3.common.synchronization [None req-1e057ad0-d3b0-4dac-9246-fba49c1f2d17 None None] Enqueued Resource ID: a598a66b-e72f-42a6-bdb2-c1eb7275eca4 with Priority: HIGHEST for action port [ 619.358519] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a598a66b-e72f-42a6-bdb2-c1eb7275eca4 with Priority: HIGHEST for action port [ 619.359191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a598a66b-e72f-42a6-bdb2-c1eb7275eca4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.359340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a598a66b-e72f-42a6-bdb2-c1eb7275eca4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.359415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a598a66b-e72f-42a6-bdb2-c1eb7275eca4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.359643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a598a66b-e72f-42a6-bdb2-c1eb7275eca4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.359734] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a598a66b-e72f-42a6-bdb2-c1eb7275eca4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.472465] env[62815]: INFO networking_nsxv3.common.synchronization [req-a13a8f7f-be01-4ec9-951f-24603d62f624 req-bd8770b0-989b-4e6e-a225-7cf938bb9b7c tempest-InstanceActionsV221TestJSON-286921900 tempest-InstanceActionsV221TestJSON-286921900-project-member] Enqueued Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_members [ 619.474601] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_members [ 619.476461] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.477179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.477259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.477526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.477700] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.477827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.477866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.478629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.478629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.478629] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.549492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e35c154-0435-4483-9e36-6b5b0743a355 [ 619.549733] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.550016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.550115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.550334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.550430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.550530] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e35c154-0435-4483-9e36-6b5b0743a355 already deleted. [ 619.550690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e35c154-0435-4483-9e36-6b5b0743a355" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.771361] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.771670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.772233] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.773857] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9ff2051-c932-4a2a-a614-144545ab3573 with status ACTIVE [ 619.774235] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.774456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.774666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.775438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.775511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.775693] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.776407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.776407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.776407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.776407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.776407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.776407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.776669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.776669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.776731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.776959] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9ff2051-c932-4a2a-a614-144545ab3573 is going to be updated. [ 619.797642] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.797952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.797952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.798086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.800977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.802016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ff2051-c932-4a2a-a614-144545ab3573" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.864934] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a598a66b-e72f-42a6-bdb2-c1eb7275eca4 [ 619.864934] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.864934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.864934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.865489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.865563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.865637] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a598a66b-e72f-42a6-bdb2-c1eb7275eca4 already deleted. [ 619.865720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a598a66b-e72f-42a6-bdb2-c1eb7275eca4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.983010] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.983184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.983246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.983523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.983621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.983873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.983982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 619.984068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.984316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 619.984390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 619.984459] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 already deleted. [ 619.985093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.135476] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.136186] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.138302] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.138757] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.139610] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.139610] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.140132] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.140132] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.140527] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.140962] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.142166] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.142343] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.142510] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.142672] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.142829] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.143023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.165532] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.165700] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 620.165834] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.166019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.166339] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-adf17cde-41c2-4466-be6f-aef9ab980aa4 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.166512] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.166658] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.166985] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.173811] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adf17cde-41c2-4466-be6f-aef9ab980aa4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.279347] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.681304] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.681598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.681726] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.682104] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.682270] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.682493] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port adf17cde-41c2-4466-be6f-aef9ab980aa4 not found, creating... [ 620.685995] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.685995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.685995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.685995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.685995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.685995] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.685995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.685995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.686692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.686692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.686692] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: adf17cde-41c2-4466-be6f-aef9ab980aa4 is going to be created. [ 620.712261] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.712738] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.713531] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.714876] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.714876] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.714876] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.732024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 620.732024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.732024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.732024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.732024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.732024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.732911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.733332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.734467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.734467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.734467] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.734467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.734467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.734826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.734966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.735181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.735299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.735515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.735647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.735785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.735945] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.782808] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.783372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.783372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.783522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.783581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.783717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 is going to be created. [ 620.823384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.823543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 620.823640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.823928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 620.824084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 620.838080] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 in Status: UNINITIALIZED for 2s [ 621.242323] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db29840-7ccf-49ac-af49-fd6b13cfbba7: rpc.has_security_group_logging(os_id): False [ 621.264493] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.264493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.264493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.264493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.264493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.264493] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.264997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.264997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.264997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.264997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.265150] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.265198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.266784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.266784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.266784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.266784] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.266784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.266784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.268553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.268553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.268553] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be created. [ 621.325158] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.325391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.325391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.325595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.325784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.336894] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: IN_PROGRESS for 2s [ 621.492272] env[62815]: INFO networking_nsxv3.common.synchronization [None req-de810303-238a-4d50-9aa8-201db586225a None None] Enqueued Resource ID: 039b32b0-6f7f-4047-82f7-4bd0920e4344 with Priority: HIGHEST for action port [ 621.493746] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039b32b0-6f7f-4047-82f7-4bd0920e4344 with Priority: HIGHEST for action port [ 621.493746] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-039b32b0-6f7f-4047-82f7-4bd0920e4344 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.493746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-039b32b0-6f7f-4047-82f7-4bd0920e4344" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.493746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-039b32b0-6f7f-4047-82f7-4bd0920e4344" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.494180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-039b32b0-6f7f-4047-82f7-4bd0920e4344" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.494180] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('039b32b0-6f7f-4047-82f7-4bd0920e4344',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.936608] env[62815]: INFO networking_nsxv3.common.synchronization [req-a13a8f7f-be01-4ec9-951f-24603d62f624 req-94ca6bb8-26b1-4e5b-92ce-d88425aaf3db service nova] Enqueued Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_rules [ 621.936911] env[62815]: INFO networking_nsxv3.common.synchronization [req-a13a8f7f-be01-4ec9-951f-24603d62f624 req-94ca6bb8-26b1-4e5b-92ce-d88425aaf3db service nova] Enqueued Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_members [ 621.936947] env[62815]: INFO networking_nsxv3.common.synchronization [req-a13a8f7f-be01-4ec9-951f-24603d62f624 req-94ca6bb8-26b1-4e5b-92ce-d88425aaf3db service nova] Enqueued Resource ID: adf17cde-41c2-4466-be6f-aef9ab980aa4 with Priority: HIGHEST for action port [ 621.937194] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_rules [ 621.937322] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_members [ 621.937420] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf17cde-41c2-4466-be6f-aef9ab980aa4 with Priority: HIGHEST for action port [ 621.938316] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.942516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.942598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.942965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.943427] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.944658] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.944773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.944847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.945053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.950025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 621.950025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.950025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-adf17cde-41c2-4466-be6f-aef9ab980aa4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.950025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 621.950025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adf17cde-41c2-4466-be6f-aef9ab980aa4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.000147] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 039b32b0-6f7f-4047-82f7-4bd0920e4344 [ 622.000404] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.000665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.000665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.000837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.000929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.001126] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:039b32b0-6f7f-4047-82f7-4bd0920e4344 already deleted. [ 622.001126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-039b32b0-6f7f-4047-82f7-4bd0920e4344" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.452651] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.452879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.452972] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.453965] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adf17cde-41c2-4466-be6f-aef9ab980aa4 with status ACTIVE [ 622.454228] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.454395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.454395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.454962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.454962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.454962] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.454962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.455192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.455227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.455370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.455778] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.455778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.456090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.456090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.456299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.456491] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adf17cde-41c2-4466-be6f-aef9ab980aa4 is going to be updated. [ 622.480648] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.480798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.480871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.481404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.481404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.481404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adf17cde-41c2-4466-be6f-aef9ab980aa4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.846607] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 in Status: SUCCESS [ 622.846868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.847041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.847271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.847486] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.847611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 622.847727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.847840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 622.847930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.848017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 622.848121] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.959448] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.348943] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 623.349209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.349461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.349600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.349718] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.350745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.350892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.350947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.355546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.355546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.355546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.355546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.355546] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.461936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.464101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.464101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.464101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.464101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.464101] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 is going to be created. [ 623.491481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.491481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.491481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.491481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.491481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.500252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 in Status: UNINITIALIZED for 2s [ 623.529203] env[62815]: INFO networking_nsxv3.common.synchronization [req-5746b65c-da66-432b-a68e-e08e3b2fce33 req-941f27a3-aef3-40e1-8143-c5ac862d9c92 tempest-ServerMetadataNegativeTestJSON-1515027532 tempest-ServerMetadataNegativeTestJSON-1515027532-project-member] Enqueued Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_members [ 623.529881] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a with Priority: HIGHEST for action security_group_members [ 623.530324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.530324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.530537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.531023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.531120] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.531399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.531399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.531502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.531549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.532031] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.858582] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9570a2bb-1432-4892-8f5f-0ca9a33988d0: rpc.has_security_group_logging(os_id): False [ 623.862551] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.865021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.865021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.865021] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.882580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.882580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.882580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.882580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.882883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.882883] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.882960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.882994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.886778] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.886778] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.886778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.886778] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 is going to be created. [ 623.943903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.944538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 623.944844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.945164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 623.948025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 623.955440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 in Status: IN_PROGRESS for 2s [ 624.034399] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.034399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.034731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.034731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.034731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.034978] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.035055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.035102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.035220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.035293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.035376] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a is going to be updated. [ 624.065041] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.065041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.065041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.065317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.065519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.076099] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a in Status: IN_PROGRESS for 2s [ 624.367750] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.368059] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.368330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.368442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.368621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.368747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.368747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.368930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.369018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.369183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.369341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.369614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.369614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.369771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.369906] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.371593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.371657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.371796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.371892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.372008] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.372182] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.879667] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7db29840-7ccf-49ac-af49-fd6b13cfbba7: rpc.has_security_group_logging(os_id): False [ 624.898990] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.902811] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.902811] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.902811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.904168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.904378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.904416] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.905790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.905790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.905790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.905790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.905790] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be updated. [ 624.943611] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2be7cc9e-68a0-4387-a5de-54c40384c40a None None] Enqueued Resource ID: 1eb284e9-7af4-4f72-a080-88767854acbb with Priority: HIGHEST for action port [ 624.943611] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb284e9-7af4-4f72-a080-88767854acbb with Priority: HIGHEST for action port [ 624.944392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eb284e9-7af4-4f72-a080-88767854acbb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.944826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eb284e9-7af4-4f72-a080-88767854acbb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.944826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eb284e9-7af4-4f72-a080-88767854acbb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.944935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eb284e9-7af4-4f72-a080-88767854acbb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.944997] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eb284e9-7af4-4f72-a080-88767854acbb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.961609] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.961786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 624.961786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.962032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 624.964448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 624.986527] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: IN_PROGRESS for 2s [ 625.447892] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1eb284e9-7af4-4f72-a080-88767854acbb [ 625.448262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.449392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.449539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.450550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.450550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.450550] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1eb284e9-7af4-4f72-a080-88767854acbb already deleted. [ 625.450550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eb284e9-7af4-4f72-a080-88767854acbb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.510871] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 in Status: SUCCESS [ 625.511194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.511390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.513407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.513407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.513407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 625.513407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.513407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 625.513407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.513407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 625.513407] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.967905] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 in Status: SUCCESS [ 625.968149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.014684] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.014773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.014826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.015272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.015272] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.015442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.015442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.015644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.015742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.016040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.017062] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.017062] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.017062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.017446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.017446] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.086974] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a in Status: SUCCESS [ 626.087173] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a deletion is rescheduled due to dependency. [ 626.087292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.432740] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-9c8d830e-731a-4602-bbe7-e26567c4b2ca tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 626.432740] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 626.433976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.434521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.434521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.436169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.436169] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.436169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.436169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.436169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.436381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.436753] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.520154] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21b0e5c1-1fe6-480e-963c-67f29a11cd78: rpc.has_security_group_logging(os_id): False [ 626.537817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.537959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.538041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.538263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.538351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.538531] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.538629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.538691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.538832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.538959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.539115] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.539209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.539266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.539404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.539476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.539674] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.539764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.539822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.539957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.540470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.540696] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 is going to be created. [ 626.596493] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.596629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.596696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.596997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.597331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.609466] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 in Status: IN_PROGRESS for 2s [ 626.942487] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.942487] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 626.942487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e already deleted. [ 626.942487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.004473] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 627.004991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.017574] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.017806] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.017964] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.018352] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.018676] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.018863] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.019031] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.019290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.019464] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.019692] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.019811] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.019947] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.020229] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.020359] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.020500] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.020667] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.040593] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.040593] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.040593] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.040593] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.040790] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.041027] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.041121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.041444] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.041563] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2479baaf-a3b1-4207-8bce-e6eecfc39fb6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.546183] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.546468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.546509] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.546779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.546946] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.547143] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2479baaf-a3b1-4207-8bce-e6eecfc39fb6 not found, creating... [ 627.547770] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.547770] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.547770] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.548043] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.548088] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.548350] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.548536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.551573] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.551962] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.552044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.552208] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2479baaf-a3b1-4207-8bce-e6eecfc39fb6 is going to be created. [ 627.588341] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.588610] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.588776] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.589412] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.589705] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.590094] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 627.974148] env[62815]: INFO networking_nsxv3.common.synchronization [None req-b5f23970-6b49-48e5-b23c-519e5fd1c990 None None] Enqueued Resource ID: 5d39d8dc-ad71-4bb9-b1db-83a8d46bb505 with Priority: HIGHEST for action port [ 627.974148] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d39d8dc-ad71-4bb9-b1db-83a8d46bb505 with Priority: HIGHEST for action port [ 627.974148] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d39d8dc-ad71-4bb9-b1db-83a8d46bb505 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.974148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d39d8dc-ad71-4bb9-b1db-83a8d46bb505" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 627.974148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d39d8dc-ad71-4bb9-b1db-83a8d46bb505" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.974148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d39d8dc-ad71-4bb9-b1db-83a8d46bb505" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 627.974510] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d39d8dc-ad71-4bb9-b1db-83a8d46bb505',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.296581] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-467f5144-6114-4e7b-bcde-7c6ff54f1ba3 service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 628.296829] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-467f5144-6114-4e7b-bcde-7c6ff54f1ba3 service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 628.296951] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-467f5144-6114-4e7b-bcde-7c6ff54f1ba3 service nova] Enqueued Resource ID: 2479baaf-a3b1-4207-8bce-e6eecfc39fb6 with Priority: HIGHEST for action port [ 628.297192] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 628.297335] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 628.297470] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2479baaf-a3b1-4207-8bce-e6eecfc39fb6 with Priority: HIGHEST for action port [ 628.298037] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.300996] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.300996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.300996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.300996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.300996] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.301914] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.301914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.301914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.301914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.302271] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2479baaf-a3b1-4207-8bce-e6eecfc39fb6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.478990] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d39d8dc-ad71-4bb9-b1db-83a8d46bb505 [ 628.479244] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.479385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.479468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.479686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.479801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.480013] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d39d8dc-ad71-4bb9-b1db-83a8d46bb505 already deleted. [ 628.480013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d39d8dc-ad71-4bb9-b1db-83a8d46bb505" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.622909] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 in Status: SUCCESS [ 628.623245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.807821] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.812033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.812216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.812368] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2479baaf-a3b1-4207-8bce-e6eecfc39fb6 with status ACTIVE [ 628.812601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.812749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.812853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.812996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.814440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.814734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.814920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.815056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.817027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.817027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.817027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.817027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.817027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.817027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.817027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.817027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2479baaf-a3b1-4207-8bce-e6eecfc39fb6 is going to be updated. [ 628.840923] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.841177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 628.841322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.841499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 628.841671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 628.841877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2479baaf-a3b1-4207-8bce-e6eecfc39fb6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.000800] env[62815]: INFO networking_nsxv3.common.synchronization [None req-34fc71df-ed0a-425b-84b7-3fe8dc39e5af None None] Enqueued Resource ID: b4efb99b-08f2-47b1-8747-0cc0659f824e with Priority: HIGHEST for action port [ 629.001407] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4efb99b-08f2-47b1-8747-0cc0659f824e with Priority: HIGHEST for action port [ 629.002146] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4efb99b-08f2-47b1-8747-0cc0659f824e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.002282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4efb99b-08f2-47b1-8747-0cc0659f824e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.002352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4efb99b-08f2-47b1-8747-0cc0659f824e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.002603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4efb99b-08f2-47b1-8747-0cc0659f824e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.002689] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4efb99b-08f2-47b1-8747-0cc0659f824e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.323270] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.505095] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4efb99b-08f2-47b1-8747-0cc0659f824e [ 629.505466] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.506425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.506506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.506724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.506820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.506927] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4efb99b-08f2-47b1-8747-0cc0659f824e already deleted. [ 629.507041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4efb99b-08f2-47b1-8747-0cc0659f824e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.826364] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.826672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.826672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.826836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.826876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.826999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be created. [ 629.854001] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.854001] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 629.854001] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.854001] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 629.854001] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 629.860817] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: UNINITIALIZED for 2s [ 631.136315] env[62815]: INFO networking_nsxv3.common.synchronization [None req-6ee4988b-4620-402a-aa01-43f4aa68a17b None None] Enqueued Resource ID: 9f21b146-894a-47dd-b7b6-58b10a00fcb0 with Priority: HIGHEST for action port [ 631.136315] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f21b146-894a-47dd-b7b6-58b10a00fcb0 with Priority: HIGHEST for action port [ 631.136315] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f21b146-894a-47dd-b7b6-58b10a00fcb0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.136315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f21b146-894a-47dd-b7b6-58b10a00fcb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.136315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f21b146-894a-47dd-b7b6-58b10a00fcb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.136315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f21b146-894a-47dd-b7b6-58b10a00fcb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.136315] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f21b146-894a-47dd-b7b6-58b10a00fcb0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.645036] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f21b146-894a-47dd-b7b6-58b10a00fcb0 [ 631.645036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.645036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.645036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.645036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.645036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.645036] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f21b146-894a-47dd-b7b6-58b10a00fcb0 already deleted. [ 631.645036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f21b146-894a-47dd-b7b6-58b10a00fcb0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.872385] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 631.872641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.872816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.873153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.874116] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.874116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 631.874116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.874116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 631.874116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.874116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 631.874116] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.376935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.377375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.377375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.377477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.377573] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.377673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.379023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.379023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.379023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.379576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.379576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.379576] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.508438] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-8a20a86c-fd5c-42cd-877f-01e9a8c78f68 tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 632.508438] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 632.508438] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.508438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.508438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.508438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.508438] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.513705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.513705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.513705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.513705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.513705] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.881642] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a93e2c7-70fc-4898-bef6-476829a0870e: rpc.has_security_group_logging(os_id): False [ 632.899310] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.899459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.899532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.899744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.899887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.900055] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.900156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.900221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.900375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.900453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.900659] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.900725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.900773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.900929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.900975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.901163] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.901260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.901316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.901453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.901565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.901617] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be created. [ 632.958735] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.958886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 632.958962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.963016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 632.963016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 632.969642] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 633.015210] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.020034] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.020034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.020034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.020034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.020034] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.020034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.020034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.021436] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.021711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.021896] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.022086] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.024032] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.024032] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.024032] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.024032] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.024032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.063578] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.063748] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.063894] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.064103] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.064419] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.064602] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.064725] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.065674] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.065674] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba53e1a-c205-4bd6-bd27-d72e77b5a430',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.458634] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f6e7a6c-f876-40de-83c4-54caa35d8106 req-e8b376c1-dd83-4a4a-bccd-178cbd40abd3 tempest-InstanceActionsV221TestJSON-286921900 tempest-InstanceActionsV221TestJSON-286921900-project-member] Enqueued Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_members [ 633.458919] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 with Priority: HIGHEST for action security_group_members [ 633.459298] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b0e5c1-1fe6-480e-963c-67f29a11cd78 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.459427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.459496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.459697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.459851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.459948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.460019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.461611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.461706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.461819] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b0e5c1-1fe6-480e-963c-67f29a11cd78',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.517022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.569989] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.570307] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.570440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.570743] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.570896] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.571114] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 3ba53e1a-c205-4bd6-bd27-d72e77b5a430 not found, creating... [ 633.571357] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.571517] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.571637] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.571857] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.572009] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.572300] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.572459] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.572578] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.572786] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.572923] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.573383] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 3ba53e1a-c205-4bd6-bd27-d72e77b5a430 is going to be created. [ 633.592330] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.592532] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.592660] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.592917] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.593160] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.593380] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.964221] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.964375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.964467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.964748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.964949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.965092] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.965232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.965298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.965438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.965519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 633.965607] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 is going to be updated. [ 633.991536] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.991700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 633.991747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.991946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 633.992100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.000249] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 in Status: IN_PROGRESS for 2s [ 634.021066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.021292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.021462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.021612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.021728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.021728] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 634.045973] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.046256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.046256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.046510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.046627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.064813] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 634.390937] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-6e91751b-719f-4871-8027-8bd8d30f14ef service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 634.391139] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-6e91751b-719f-4871-8027-8bd8d30f14ef service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 634.391288] env[62815]: INFO networking_nsxv3.common.synchronization [req-0c93afe5-3a4f-4ec1-887f-fd7b970e5ecd req-6e91751b-719f-4871-8027-8bd8d30f14ef service nova] Enqueued Resource ID: 3ba53e1a-c205-4bd6-bd27-d72e77b5a430 with Priority: HIGHEST for action port [ 634.391778] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 634.391961] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 634.392018] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba53e1a-c205-4bd6-bd27-d72e77b5a430 with Priority: HIGHEST for action port [ 634.395048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.395048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.395048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.395048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.395235] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.395313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.395368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.396573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.396573] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba53e1a-c205-4bd6-bd27-d72e77b5a430',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.901141] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ba53e1a-c205-4bd6-bd27-d72e77b5a430 with status ACTIVE [ 634.904818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.904818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.904818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.904818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.904818] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ba53e1a-c205-4bd6-bd27-d72e77b5a430 is going to be updated. [ 634.925997] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.925997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 634.925997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.925997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.925997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.925997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ba53e1a-c205-4bd6-bd27-d72e77b5a430" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.996523] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 634.996523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 634.996523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.996523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 634.996523] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.093177] env[62815]: INFO networking_nsxv3.common.synchronization [req-d226f0af-2394-4b41-96a1-5726008494fc req-6b235bff-acbe-4a43-a2f7-c3351b0a4419 tempest-ServerDiagnosticsNegativeTest-703010747 tempest-ServerDiagnosticsNegativeTest-703010747-project-member] Enqueued Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_members [ 635.093894] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_members [ 635.094419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.094569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.094624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.094927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.095062] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.095186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.095235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.095387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.095656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.095767] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.457590] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.457784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.457919] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.458229] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.458844] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.460019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.460176] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.460439] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.460596] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.460806] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.460921] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.461043] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.461151] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.461260] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.461389] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.461535] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.481101] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.481362] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 635.481473] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.481635] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.481635] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-a40ca88b-b87f-432c-be08-0cdccd7633e9 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.481635] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.481635] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.482740] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.482740] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a40ca88b-b87f-432c-be08-0cdccd7633e9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.501546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.501748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.598015] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.598331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.598331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.598781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.598781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.598781] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.598933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.598933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.599065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.601925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.601925] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a already deleted. [ 635.601925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.987779] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.987779] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port a40ca88b-b87f-432c-be08-0cdccd7633e9 not found, creating... [ 635.987779] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.987779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.988713] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.988713] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 635.988713] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.989153] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 635.989444] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 635.989710] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: a40ca88b-b87f-432c-be08-0cdccd7633e9 is going to be created. [ 636.009652] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 in Status: SUCCESS [ 636.009888] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b0e5c1-1fe6-480e-963c-67f29a11cd78 deletion is rescheduled due to dependency. [ 636.010046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b0e5c1-1fe6-480e-963c-67f29a11cd78" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.017531] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.017762] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.017891] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.018213] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.018441] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.018692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.075965] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 636.077128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.077382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.078097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.078334] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.079311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 636.079436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.080691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 636.080691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 636.080691] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.583126] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.089397] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.206879] env[62815]: INFO networking_nsxv3.common.synchronization [req-d226f0af-2394-4b41-96a1-5726008494fc req-1b974d92-cca0-4cfa-9f9d-d059f50a0745 service nova] Enqueued Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_rules [ 637.207236] env[62815]: INFO networking_nsxv3.common.synchronization [req-d226f0af-2394-4b41-96a1-5726008494fc req-1b974d92-cca0-4cfa-9f9d-d059f50a0745 service nova] Enqueued Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_members [ 637.207445] env[62815]: INFO networking_nsxv3.common.synchronization [req-d226f0af-2394-4b41-96a1-5726008494fc req-1b974d92-cca0-4cfa-9f9d-d059f50a0745 service nova] Enqueued Resource ID: a40ca88b-b87f-432c-be08-0cdccd7633e9 with Priority: HIGHEST for action port [ 637.208592] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_rules [ 637.208772] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_members [ 637.208996] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40ca88b-b87f-432c-be08-0cdccd7633e9 with Priority: HIGHEST for action port [ 637.209532] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.209716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.209820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.210134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.210248] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.213278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.213436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.213506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.213693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.214049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.214049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.214049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.214234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.214270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.214358] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.215138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a40ca88b-b87f-432c-be08-0cdccd7633e9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.215244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.215308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.215461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.215539] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a40ca88b-b87f-432c-be08-0cdccd7633e9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.591928] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.592104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.592210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.592436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.593051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.593051] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 637.633360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.633630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.633680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.633912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.634091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.648995] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 637.719449] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.719449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.719643] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.720577] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a40ca88b-b87f-432c-be08-0cdccd7633e9 with status ACTIVE [ 637.720873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.721142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.721142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.721466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.721598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.722279] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.722279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.722524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.723812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.723812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.723812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.723812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.723812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.723812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.724098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.724098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a40ca88b-b87f-432c-be08-0cdccd7633e9 is going to be updated. [ 637.756869] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.757118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 637.757259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.757548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 637.757770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 637.757960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a40ca88b-b87f-432c-be08-0cdccd7633e9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.227302] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.362794] env[62815]: INFO networking_nsxv3.common.synchronization [None req-b5052ad1-dcc9-425a-95fa-430aecfb60c2 None None] Enqueued Resource ID: 9e3d9717-f184-4ad8-8550-291267bfc587 with Priority: HIGHEST for action port [ 638.363088] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e3d9717-f184-4ad8-8550-291267bfc587 with Priority: HIGHEST for action port [ 638.364457] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e3d9717-f184-4ad8-8550-291267bfc587 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.364457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e3d9717-f184-4ad8-8550-291267bfc587" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.364457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e3d9717-f184-4ad8-8550-291267bfc587" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.368375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e3d9717-f184-4ad8-8550-291267bfc587" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.368375] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e3d9717-f184-4ad8-8550-291267bfc587',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.420638] env[62815]: INFO networking_nsxv3.common.synchronization [req-2abbb99b-c2d6-42c6-a10d-8e22a9603293 req-95078e69-a2dc-4d00-ba79-d7c8350fff01 tempest-FloatingIPsAssociationTestJSON-821854022 tempest-FloatingIPsAssociationTestJSON-821854022-project-member] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 638.421136] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 638.421483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.421576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.421631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.421868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.422080] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.422169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.422236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.422413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.422498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.422593] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.731471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.731638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.731713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.731941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.732078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.732145] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a is going to be created. [ 638.755936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.755936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.755936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.756186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.757103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.768086] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a in Status: UNINITIALIZED for 2s [ 638.870755] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e3d9717-f184-4ad8-8550-291267bfc587 [ 638.871014] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.871190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.871275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.871517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.871604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.871704] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e3d9717-f184-4ad8-8550-291267bfc587 already deleted. [ 638.871786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e3d9717-f184-4ad8-8550-291267bfc587" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.884728] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.885066] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.889023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.889023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.889023] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.889023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.889023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.889023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.889023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.889023] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.889023] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.889023] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.889023] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.889023] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.889023] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.889023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.907634] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.909259] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.909589] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.909890] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.910584] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.912237] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.912381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.912729] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.912875] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7141ea1e-1ca6-4287-b6b8-0455fb4139ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.925212] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.925332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.925390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.925634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.925708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.925885] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.925969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 638.926016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.926147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 638.926217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 638.926299] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a already deleted. [ 638.927015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.419019] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.419019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 7141ea1e-1ca6-4287-b6b8-0455fb4139ca not found, creating... [ 639.419019] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.419019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.419984] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.419984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.419984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.420846] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.421438] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.421850] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 7141ea1e-1ca6-4287-b6b8-0455fb4139ca is going to be created. [ 639.441892] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.441892] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.441892] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.442142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.442414] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.442693] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.658826] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 639.659104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.659289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.659514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.659981] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.660179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.660249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.660434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.660523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.660611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 639.660700] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.745841] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5797d23d-52ea-4a0c-b11b-9033b5121266 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_rules [ 639.745841] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_rules [ 639.745841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.745956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 639.745980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.747061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 639.747061] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.905102] env[62815]: INFO networking_nsxv3.common.synchronization [None req-699ab186-1132-4306-a0bc-d5a8cb21e06b tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_rules [ 639.905609] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_rules [ 639.905884] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.906079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.165386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.165386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.165386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.165386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.171028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.171028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.171028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.171028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.171028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.171028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.171028] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.267552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.269682] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d already deleted. [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.269682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.269682] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.395361] env[62815]: INFO networking_nsxv3.common.synchronization [None req-ae17fec7-dbd2-4b58-b9c9-773d020379ae None None] Enqueued Resource ID: d3084198-ed37-4a80-a736-56662a66f564 with Priority: HIGHEST for action port [ 640.395361] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3084198-ed37-4a80-a736-56662a66f564 with Priority: HIGHEST for action port [ 640.395361] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3084198-ed37-4a80-a736-56662a66f564 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.396428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3084198-ed37-4a80-a736-56662a66f564" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.396634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3084198-ed37-4a80-a736-56662a66f564" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.397310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3084198-ed37-4a80-a736-56662a66f564" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.397483] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3084198-ed37-4a80-a736-56662a66f564',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.570899] env[62815]: INFO networking_nsxv3.common.synchronization [req-d5844215-9abf-475e-a937-8a4b64e7657d req-1d8620c1-e1dd-49fd-8624-8ab35f3970f8 tempest-FloatingIPsAssociationNegativeTestJSON-1722081294 tempest-FloatingIPsAssociationNegativeTestJSON-1722081294-project-member] Enqueued Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_members [ 640.570899] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGHEST for action security_group_members [ 640.570899] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.570899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.570899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.571872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.572172] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.572449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.572616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.572883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.573410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.573695] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.621322] env[62815]: INFO networking_nsxv3.common.synchronization [req-dcca562e-bf69-4a6c-9a82-67dca4ac7632 req-bdcf243a-2607-4eb5-a704-fb7424625cdb tempest-ImagesOneServerTestJSON-1093200441 tempest-ImagesOneServerTestJSON-1093200441-project-member] Enqueued Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_members [ 640.627518] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d with Priority: HIGHEST for action security_group_members [ 640.629079] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.629079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.629079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.629258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.629515] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.629975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.630090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.630296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.630415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.630534] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.674592] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a93e2c7-70fc-4898-bef6-476829a0870e: rpc.has_security_group_logging(os_id): False [ 640.693132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.693132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.693132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.693132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.693575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.696485] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.696790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.696943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.697221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.697388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.697542] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 640.765531] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.767985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.768427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.768955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.770385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.776734] env[62815]: INFO networking_nsxv3.common.synchronization [req-2abbb99b-c2d6-42c6-a10d-8e22a9603293 req-1fd0bd38-a890-4c7c-909d-a4ad9080b69d service nova] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_rules [ 640.780188] env[62815]: INFO networking_nsxv3.common.synchronization [req-2abbb99b-c2d6-42c6-a10d-8e22a9603293 req-1fd0bd38-a890-4c7c-909d-a4ad9080b69d service nova] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 640.780447] env[62815]: INFO networking_nsxv3.common.synchronization [req-2abbb99b-c2d6-42c6-a10d-8e22a9603293 req-1fd0bd38-a890-4c7c-909d-a4ad9080b69d service nova] Enqueued Resource ID: 7141ea1e-1ca6-4287-b6b8-0455fb4139ca with Priority: HIGHEST for action port [ 640.782681] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_rules [ 640.783213] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 640.786189] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7141ea1e-1ca6-4287-b6b8-0455fb4139ca with Priority: HIGHEST for action port [ 640.786554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.786692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.786762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.787061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.787160] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.788144] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.788289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.788333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.788505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.789281] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.789281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.789281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.789281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.789281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.789281] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.791160] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.791160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.791160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.791160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.791160] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7141ea1e-1ca6-4287-b6b8-0455fb4139ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.793334] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 640.793334] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a in Status: SUCCESS [ 640.793334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.794055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.794055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.794055] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.794055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.794055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.794055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.794215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.794215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.794361] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.800546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.800680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.800743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.800936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.801082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.801125] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d already deleted. [ 640.801212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.902067] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3084198-ed37-4a80-a736-56662a66f564 [ 640.902067] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.902067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 640.902067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.902067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 640.902067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 640.902067] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3084198-ed37-4a80-a736-56662a66f564 already deleted. [ 640.902067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3084198-ed37-4a80-a736-56662a66f564" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.076513] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.076826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.076914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.077259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.077702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.078960] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.078960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.078960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.078960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.078960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.078960] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 is going to be updated. [ 641.109623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.109623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.109623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.109623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.110796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.121983] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 in Status: IN_PROGRESS for 2s [ 641.133800] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.133800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.133899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.134054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.134146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.134355] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.134456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.134516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.135261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.135261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.135261] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d is going to be updated. [ 641.161677] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.161871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.161932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.162221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.162368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.172659] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d in Status: IN_PROGRESS for 2s [ 641.293790] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.293790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.295995] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.297128] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7141ea1e-1ca6-4287-b6b8-0455fb4139ca with status ACTIVE [ 641.297448] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.297632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.297683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.297919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.298064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.298665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.298665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.298665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.298665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.299084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.299084] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.299084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.301609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.301609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.301609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.301609] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7141ea1e-1ca6-4287-b6b8-0455fb4139ca is going to be updated. [ 641.301850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.305031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.305031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.305031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.305823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.306482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.306482] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.306482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.306482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.306669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.306669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.306969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.307161] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.328019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.328019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.328654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.328890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.329237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.329321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7141ea1e-1ca6-4287-b6b8-0455fb4139ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.810035] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.811026] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2474a688-4edd-47c2-8e2f-90218dd98e8a: rpc.has_security_group_logging(os_id): False [ 641.831965] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.832188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.832285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.832525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.832649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.832901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.833464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.833605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.833802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.833915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.834148] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.834288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.834371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.834543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.834824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.834878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.834960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.835034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.835188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.835272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.835360] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a is going to be created. [ 641.890346] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.890536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 641.890735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.890984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 641.891533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 641.902823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a in Status: IN_PROGRESS for 2s [ 642.316973] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.316973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.316973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.316973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.316973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.316973] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be created. [ 642.340258] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.340452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 642.340529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.340921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 642.341175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 642.352710] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: UNINITIALIZED for 2s [ 642.803887] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 642.804194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.139068] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 in Status: SUCCESS [ 643.139068] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 deletion is rescheduled due to dependency. [ 643.139068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.183469] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d in Status: SUCCESS [ 643.183651] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d deletion is rescheduled due to dependency. [ 643.183769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.364332] env[62815]: INFO networking_nsxv3.common.synchronization [req-8389e0c7-aa7c-4b11-a66a-727b1211bfba req-a67e0860-6c72-4c30-a8f6-5efafed2f8d7 tempest-ServerActionsV293TestJSON-1409986256 tempest-ServerActionsV293TestJSON-1409986256-project-member] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_members [ 643.364864] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_members [ 643.365190] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.365309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.365377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.366141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.366141] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.366268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.366303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.366510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.366573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.366645] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.449364] env[62815]: INFO networking_nsxv3.common.synchronization [None req-bb4f64fb-82b1-4a72-a0d0-c00839e3cdcc None None] Enqueued Resource ID: d8fc0e86-51cf-42ce-8b83-0f404a926e07 with Priority: HIGHEST for action port [ 643.449960] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fc0e86-51cf-42ce-8b83-0f404a926e07 with Priority: HIGHEST for action port [ 643.453555] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fc0e86-51cf-42ce-8b83-0f404a926e07 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.453695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fc0e86-51cf-42ce-8b83-0f404a926e07" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.453765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fc0e86-51cf-42ce-8b83-0f404a926e07" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.454057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fc0e86-51cf-42ce-8b83-0f404a926e07" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.454158] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fc0e86-51cf-42ce-8b83-0f404a926e07',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.786126] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.786126] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-991" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.786126] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-991" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.786126] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-991" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.787526] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.787737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.787877] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.788175] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.788289] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.788504] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.788620] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.788731] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.788841] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.788945] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.789070] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.789235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.806854] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.807048] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.807229] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.807440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-991" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.807768] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-fd4df151-8b5f-4155-afdc-d5371d2f5751 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.807944] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.808079] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.808411] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.808553] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd4df151-8b5f-4155-afdc-d5371d2f5751',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.869886] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.869886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.869886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.869886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.869886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.869886] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.869886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.869886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.870236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.870236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.870236] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 already deleted. [ 643.870317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.914930] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a in Status: SUCCESS [ 643.915174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.959617] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8fc0e86-51cf-42ce-8b83-0f404a926e07 [ 643.959617] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.959617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 643.959617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.959617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 643.959617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 643.959617] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8fc0e86-51cf-42ce-8b83-0f404a926e07 already deleted. [ 643.959617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fc0e86-51cf-42ce-8b83-0f404a926e07" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.313386] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.313588] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.313588] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.313855] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.314019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.314185] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port fd4df151-8b5f-4155-afdc-d5371d2f5751 not found, creating... [ 644.314456] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.314622] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.314737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.315085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.315232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.315419] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.315600] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.316156] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.316156] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.316262] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.317057] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: fd4df151-8b5f-4155-afdc-d5371d2f5751 is going to be created. [ 644.338185] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.338426] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.338521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.338803] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.339042] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.339314] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.364464] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 644.364464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.364464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.364464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.364464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.364665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.364665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.364781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.364817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.364903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.364980] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.703114] env[62815]: INFO networking_nsxv3.common.synchronization [None req-74ad7b9d-3a19-4c7d-9bff-900d9e6ca253 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 644.703658] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 644.703961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.704100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.704167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.704506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.704538] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.859159] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f149a058-3541-48c5-8bf3-8259814bcdd1 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 644.859755] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 644.864022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.864022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.867405] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.867731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.867834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.868423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.868621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.869146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.869556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.869693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.869791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.869909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.870130] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.871397] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.871397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 644.871973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.228446] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.228709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.228709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.229165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.229165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.229309] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 already deleted. [ 645.229387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.229552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.229716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.229804] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.241258] env[62815]: INFO networking_nsxv3.common.synchronization [req-8389e0c7-aa7c-4b11-a66a-727b1211bfba req-50587f92-de4c-40a3-9bdc-73f77d99a096 service nova] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_rules [ 645.241258] env[62815]: INFO networking_nsxv3.common.synchronization [req-8389e0c7-aa7c-4b11-a66a-727b1211bfba req-50587f92-de4c-40a3-9bdc-73f77d99a096 service nova] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_members [ 645.241258] env[62815]: INFO networking_nsxv3.common.synchronization [req-8389e0c7-aa7c-4b11-a66a-727b1211bfba req-50587f92-de4c-40a3-9bdc-73f77d99a096 service nova] Enqueued Resource ID: fd4df151-8b5f-4155-afdc-d5371d2f5751 with Priority: HIGHEST for action port [ 645.241653] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_rules [ 645.241790] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_members [ 645.241887] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4df151-8b5f-4155-afdc-d5371d2f5751 with Priority: HIGHEST for action port [ 645.242231] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.242362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.242413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.242609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.242685] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.243629] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.243629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.243629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.244074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.244142] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.245242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.245242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.245242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.245242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.245242] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.245670] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd4df151-8b5f-4155-afdc-d5371d2f5751 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.245670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.245670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.245837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.245880] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd4df151-8b5f-4155-afdc-d5371d2f5751',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.374731] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3fac0c6-3de2-4540-bd01-063e50507e5a: rpc.has_security_group_logging(os_id): False [ 645.395950] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.395950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.395950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.395950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.395950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.396233] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.396233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.396233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.396388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.396423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.396625] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.396714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.396795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.396932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.396932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.397143] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.397529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.397529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.397529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.397529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.397648] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be created. [ 645.454137] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.454249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.454249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.454459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.454657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.467997] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: IN_PROGRESS for 2s [ 645.508137] env[62815]: INFO networking_nsxv3.common.synchronization [None req-333e8211-af6e-4e82-a86e-041f6f2169cf None None] Enqueued Resource ID: f8f907e9-7bcc-4028-9eba-07bce3cc312e with Priority: HIGHEST for action port [ 645.508504] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f907e9-7bcc-4028-9eba-07bce3cc312e with Priority: HIGHEST for action port [ 645.508879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f907e9-7bcc-4028-9eba-07bce3cc312e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.509020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f907e9-7bcc-4028-9eba-07bce3cc312e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.509093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f907e9-7bcc-4028-9eba-07bce3cc312e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.509612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f907e9-7bcc-4028-9eba-07bce3cc312e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.509705] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f907e9-7bcc-4028-9eba-07bce3cc312e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.749436] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.749572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.749758] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd4df151-8b5f-4155-afdc-d5371d2f5751 with status ACTIVE [ 645.749922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.750044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.750115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.750370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.750465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.750702] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.750861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.750861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.751018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.751102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.751285] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.751379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.751438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.751577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.751651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.751733] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd4df151-8b5f-4155-afdc-d5371d2f5751 is going to be updated. [ 645.756381] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.761020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.761020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.761020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.761020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.761020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.761020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 already deleted. [ 645.761020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.783761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.783920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 645.783992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.784257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 645.784395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 645.784552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd4df151-8b5f-4155-afdc-d5371d2f5751" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.012324] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8f907e9-7bcc-4028-9eba-07bce3cc312e [ 646.012599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.012736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.013904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.013904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.013904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.013904] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8f907e9-7bcc-4028-9eba-07bce3cc312e already deleted. [ 646.013904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f907e9-7bcc-4028-9eba-07bce3cc312e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.140146] env[62815]: INFO networking_nsxv3.common.synchronization [req-c99bbd04-1744-4f32-8278-ac2cb83273e4 req-ace163cd-4dbf-43aa-ae24-b0dc7c39443f tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 646.140146] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 646.140146] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.142442] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.142442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.142442] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.265031] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.537194] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.537521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.537604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.537910] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.538192] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.538359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.538477] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.538686] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.538833] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.539058] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.539210] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.539388] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.539519] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.539648] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.539827] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.539979] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.558499] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.558586] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 646.559445] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.559445] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.559445] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-c8080b46-7212-481a-8f99-261361f0e8c6 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.559897] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.559897] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.559897] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.560043] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8080b46-7212-481a-8f99-261361f0e8c6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.644165] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.644165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.644275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.644532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.644661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.644906] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.645083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.645179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.645369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.645481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.645599] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 already deleted. [ 646.645741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.768303] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.768480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.768552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.768800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.768916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.769038] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 is going to be created. [ 646.791250] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.791444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 646.791531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.791770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 646.791942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 646.800324] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13765b88-768f-4b1f-9fb5-8542df45be52 in Status: UNINITIALIZED for 2s [ 647.062779] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.063012] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.063162] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.063474] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.063630] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.063787] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port c8080b46-7212-481a-8f99-261361f0e8c6 not found, creating... [ 647.064076] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.064241] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.064355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.064578] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.064713] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.064993] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.065175] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.065291] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.065501] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.065632] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.065768] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: c8080b46-7212-481a-8f99-261361f0e8c6 is going to be created. [ 647.093014] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.093014] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.093014] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.093014] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.093014] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.093014] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.482278] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 647.482654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.898031] env[62815]: INFO networking_nsxv3.common.synchronization [req-c99bbd04-1744-4f32-8278-ac2cb83273e4 req-f6f5652c-751d-4a31-a809-7819b9e0479f service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 647.898317] env[62815]: INFO networking_nsxv3.common.synchronization [req-c99bbd04-1744-4f32-8278-ac2cb83273e4 req-f6f5652c-751d-4a31-a809-7819b9e0479f service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 647.898354] env[62815]: INFO networking_nsxv3.common.synchronization [req-c99bbd04-1744-4f32-8278-ac2cb83273e4 req-f6f5652c-751d-4a31-a809-7819b9e0479f service nova] Enqueued Resource ID: c8080b46-7212-481a-8f99-261361f0e8c6 with Priority: HIGHEST for action port [ 647.900170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 647.900170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 647.900170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8080b46-7212-481a-8f99-261361f0e8c6 with Priority: HIGHEST for action port [ 647.903104] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.903104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.903104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.903104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.903104] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.904198] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.904363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.904449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.904644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.904804] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.904920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.904956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.906107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.906230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 647.906379] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.907376] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8080b46-7212-481a-8f99-261361f0e8c6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.907525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 647.907568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.907703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 647.907833] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8080b46-7212-481a-8f99-261361f0e8c6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.412206] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.413362] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.413524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.413903] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8080b46-7212-481a-8f99-261361f0e8c6 with status ACTIVE [ 648.414085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.415029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.415029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.415029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.415029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.415029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.415029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.415029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.415439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.415439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.415439] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.415439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.415569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.415665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.415713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.415778] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8080b46-7212-481a-8f99-261361f0e8c6 is going to be updated. [ 648.435047] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.435259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.435362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.435644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.435807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.436248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8080b46-7212-481a-8f99-261361f0e8c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.813692] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13765b88-768f-4b1f-9fb5-8542df45be52 in Status: SUCCESS [ 648.813918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.814121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.814343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.814539] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.814657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.814713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.814870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.814947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.815043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.815132] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.867828] env[62815]: INFO networking_nsxv3.common.synchronization [req-eef3d78f-dfa5-465b-a064-5c7065d58239 req-6d1907b7-9e39-4f33-8225-617822afe8a3 tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 648.868457] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 648.868765] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.868887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.868959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.870922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.870922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.870922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 648.870922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.870922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 648.870922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 648.870922] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.917799] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.076758] env[62815]: INFO networking_nsxv3.common.synchronization [req-ab16e505-8d13-435c-a7da-b55d46ebceae req-d08f09c2-f184-4601-9ae9-44fd58b389e1 tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 649.077453] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 649.077881] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.078012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.306548] env[62815]: INFO networking_nsxv3.common.synchronization [req-b736f28c-5610-40d8-a771-90a51e6f1501 req-ab3b8db2-b5fb-4942-8884-48f1dfea0431 tempest-ServerDiagnosticsNegativeTest-703010747 tempest-ServerDiagnosticsNegativeTest-703010747-project-member] Enqueued Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_members [ 649.307195] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGHEST for action security_group_members [ 649.307527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.307651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.307720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.308682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.308866] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.308977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.309056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.309282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.309372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.309470] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.320516] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.373921] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.421443] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.421443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.421443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.421443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.421443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.421443] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be created. [ 649.444274] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.444454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.444492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.444710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.444867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.455803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: UNINITIALIZED for 2s [ 649.815024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.815024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.815024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.815024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a is going to be updated. [ 649.829555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13765b88-768f-4b1f-9fb5-8542df45be52: rpc.has_security_group_logging(os_id): False [ 649.833271] env[62815]: INFO networking_nsxv3.common.synchronization [None req-1bd9b9c0-c5ee-4407-9e4a-db5ddee8b09b tempest-MigrationsAdminTest-121633230 tempest-MigrationsAdminTest-121633230-project-member] Enqueued Resource ID: ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 with Priority: HIGHEST for action security_group_rules [ 649.835284] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 with Priority: HIGHEST for action security_group_rules [ 649.835284] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.835284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.835284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.835284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.835284] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.847246] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.847246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.847246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.847246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.847246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.848655] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.849059] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.849282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.849567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.849795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.850128] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.850340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.850516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.850817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.850992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.851183] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 is going to be created. [ 649.860830] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a in Status: IN_PROGRESS for 2s [ 649.877019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.911044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.911044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 649.911044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.911044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 649.911044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 649.919993] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13765b88-768f-4b1f-9fb5-8542df45be52 in Status: IN_PROGRESS for 2s [ 649.926308] env[62815]: INFO networking_nsxv3.common.synchronization [None req-cbb60f8d-92bf-4040-ae80-4a2ebf601255 tempest-MigrationsAdminTest-121633230 tempest-MigrationsAdminTest-121633230-project-member] Enqueued Resource ID: ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 with Priority: HIGHEST for action security_group_rules [ 649.926308] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 with Priority: HIGHEST for action security_group_rules [ 649.926308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.926308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.360387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.360387] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 already deleted. [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.360387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.360387] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.379429] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.379429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.379429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.379655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.379655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.379930] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 650.406288] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.406531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.407245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.407504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.407724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.417453] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 650.887012] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.887212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 650.887267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.887514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 650.887756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 650.887756] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5 already deleted. [ 650.887901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba16ae7c-1bf0-41c7-9678-74dd4a6e28b5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.442713] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f92098e-525b-4b01-933e-630287af2320 req-13a12292-b895-458f-aadc-62745556f678 tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 651.442946] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 651.443088] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.443200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.465080] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 651.465319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.465499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.465753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.465972] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.466116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.466253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.466384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.466488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.466576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.466706] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.467710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.467933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.471243] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.471399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.471474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.471681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.471776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.471892] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.845585] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.845936] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.846090] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.846600] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.846923] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.847202] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.847429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.847911] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.847911] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.848063] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.848147] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.848258] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.848366] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.848474] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.848579] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.848712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.869019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.869107] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.869239] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.869960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.869960] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-093d4134-8125-4565-80d0-2d89bcff9d39 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.869960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.870299] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.870354] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 651.870663] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('093d4134-8125-4565-80d0-2d89bcff9d39',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.872041] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a in Status: SUCCESS [ 651.872205] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a deletion is rescheduled due to dependency. [ 651.872305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.938116] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13765b88-768f-4b1f-9fb5-8542df45be52 in Status: SUCCESS [ 651.938344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 651.974428] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.974560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 651.974762] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.374222] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.374492] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.374620] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.374908] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.375075] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.375237] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 093d4134-8125-4565-80d0-2d89bcff9d39 not found, creating... [ 652.375502] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375661] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.375777] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375991] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.376141] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.376418] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.376574] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.376690] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.376899] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.377051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.377196] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 093d4134-8125-4565-80d0-2d89bcff9d39 is going to be created. [ 652.397473] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.397711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.397837] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.398125] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.398411] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.398587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.426157] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 652.426357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.426521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.426737] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.426943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.427058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.427126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.427283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.427391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.427463] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.480441] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.932634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.932817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.932891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.933135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.933229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.933423] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.933520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.933586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.933738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.933829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.933958] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 652.959620] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.959808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.959888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.960149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.960342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.976078] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 652.984311] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.984311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 652.984311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.984311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 652.984311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 652.984311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 653.009711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.009850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.009985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.010232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.010382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.021735] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 653.228169] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f92098e-525b-4b01-933e-630287af2320 req-f97ed8f3-25fc-48b4-ba5f-9073d7e6c887 service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 653.228169] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f92098e-525b-4b01-933e-630287af2320 req-f97ed8f3-25fc-48b4-ba5f-9073d7e6c887 service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 653.228169] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f92098e-525b-4b01-933e-630287af2320 req-f97ed8f3-25fc-48b4-ba5f-9073d7e6c887 service nova] Enqueued Resource ID: 093d4134-8125-4565-80d0-2d89bcff9d39 with Priority: HIGHEST for action port [ 653.228415] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 653.228415] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 653.228514] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093d4134-8125-4565-80d0-2d89bcff9d39 with Priority: HIGHEST for action port [ 653.228782] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.228881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.229134] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.229244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.229439] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-093d4134-8125-4565-80d0-2d89bcff9d39 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.229537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.229537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.229715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.229781] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('093d4134-8125-4565-80d0-2d89bcff9d39',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.735078] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 093d4134-8125-4565-80d0-2d89bcff9d39 with status ACTIVE [ 653.735556] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.735556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.735556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.735919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.735919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.736265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.736265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.736265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.736415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.736443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.736758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.736758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.736862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.736982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.736982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.737141] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 093d4134-8125-4565-80d0-2d89bcff9d39 is going to be updated. [ 653.759595] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.759595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 653.759595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.759595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 653.759595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 653.759595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-093d4134-8125-4565-80d0-2d89bcff9d39" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.112046] env[62815]: INFO networking_nsxv3.common.synchronization [req-f4af264d-b32c-4cd1-8bd9-e26d5cbcf3f9 req-332fc574-8c0a-4da0-bad1-d6cd52b6f506 tempest-DeleteServersAdminTestJSON-1887008233 tempest-DeleteServersAdminTestJSON-1887008233-project-member] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 654.112601] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 654.113064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.113245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.113293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.113467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.113622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.113719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.113796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.113929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.114027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.114204] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.556039] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.556326] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.556860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.556860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.557043] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.557215] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.557358] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.557590] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.557733] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.557949] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.558074] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.558193] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.558327] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.558401] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.558509] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.558654] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.581471] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.581471] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.581471] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.581471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.581471] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.581471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.581471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.581714] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.581834] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b88c3ad-93b4-46ab-a8dc-d1e940addf48',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.620469] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.620657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.620714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.620924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.621031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.621234] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.621424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.621424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.621542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.621616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.621702] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be updated. [ 654.646014] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.646170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 654.646247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.646468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 654.646610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 654.655808] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 2s [ 654.986809] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 654.987319] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e deletion is rescheduled due to dependency. [ 654.987319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.027858] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 655.028094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.028277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.028525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.028863] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.028863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.028978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.029095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.029185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.029338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.029500] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.029580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.029638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.029795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.029935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.030063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.030134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.030351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.030438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.030540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.030650] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.031591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.031881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.032041] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.032146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.032211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.032460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.032460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.032683] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.084732] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.085000] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.085228] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.085582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.085779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.086035] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 0b88c3ad-93b4-46ab-a8dc-d1e940addf48 not found, creating... [ 655.086352] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.086535] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.086715] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.087250] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.087440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.087797] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.088112] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.088206] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.088513] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.088700] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.088886] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 0b88c3ad-93b4-46ab-a8dc-d1e940addf48 is going to be created. [ 655.108091] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.108091] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.108091] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.108537] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.108808] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.109860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.535441] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50851b2f-e9ba-4c66-9351-f1d66386b1c2: rpc.has_security_group_logging(os_id): False [ 655.536610] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.554019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.554220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.554257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.554476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.554532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.554729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.554831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.554893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.555064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.555143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.555337] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.555433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.555493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.555632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.555706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.555898] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.555992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.556087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.556229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.556305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.556390] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be created. [ 655.611322] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.611322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 655.611322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.611322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 655.611542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 655.621805] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 656.039670] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.114900] env[62815]: INFO networking_nsxv3.common.synchronization [req-f4af264d-b32c-4cd1-8bd9-e26d5cbcf3f9 req-6915b4e2-fd53-404e-b5c9-3a0ae70ea269 service nova] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_rules [ 656.115462] env[62815]: INFO networking_nsxv3.common.synchronization [req-f4af264d-b32c-4cd1-8bd9-e26d5cbcf3f9 req-6915b4e2-fd53-404e-b5c9-3a0ae70ea269 service nova] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 656.115741] env[62815]: INFO networking_nsxv3.common.synchronization [req-f4af264d-b32c-4cd1-8bd9-e26d5cbcf3f9 req-6915b4e2-fd53-404e-b5c9-3a0ae70ea269 service nova] Enqueued Resource ID: 0b88c3ad-93b4-46ab-a8dc-d1e940addf48 with Priority: HIGHEST for action port [ 656.116454] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_rules [ 656.116654] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 656.116805] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b88c3ad-93b4-46ab-a8dc-d1e940addf48 with Priority: HIGHEST for action port [ 656.117235] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.117487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.117487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.117784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.118042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.121904] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.121904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.121904] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.121904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.121904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.121904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.121904] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b88c3ad-93b4-46ab-a8dc-d1e940addf48',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.541923] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.542097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.542173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.542394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.542489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.542590] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 656.572836] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.573019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.573074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.573283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.573424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.583959] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 656.622056] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.622222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.626640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b88c3ad-93b4-46ab-a8dc-d1e940addf48 with status ACTIVE [ 656.626791] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.626916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.626987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.627216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.627329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.627508] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.627604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.627664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.627957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.627957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.628118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.628211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.628270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.628412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.628483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.628667] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b88c3ad-93b4-46ab-a8dc-d1e940addf48 is going to be updated. [ 656.648581] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.648736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 656.649441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.649441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 656.649441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.649441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b88c3ad-93b4-46ab-a8dc-d1e940addf48" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 656.669915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 4s [ 657.635225] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 657.635544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 657.635993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.635993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 657.635993] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.140019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.140019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.594442] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 658.594652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.594828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.595063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.595279] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.595400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.595467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.595620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.595700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.595783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.595869] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.682345] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 658.682641] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 deletion is rescheduled due to dependency. [ 658.682742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.682938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.683212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.683425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.683593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 658.683673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.683869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 658.683975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 658.684122] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.101724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.101857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.101927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.102225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.102382] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.102722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.102722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.103727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.103727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.103727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.103727] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.103727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.103727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.103727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.104076] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.104076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.104076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.104167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.104195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.104264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.104354] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.188847] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.609889] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50851b2f-e9ba-4c66-9351-f1d66386b1c2: rpc.has_security_group_logging(os_id): False [ 659.624038] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.624187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.624285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.624524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.624624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.624816] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.624915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.624977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.625139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.625216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.625427] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.625528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.625590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.625733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.625810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.626011] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.634381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.634381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.634381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.634381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.634381] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 659.690552] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.696869] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.697024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.697085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.697300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.697444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.708876] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 659.965266] env[62815]: INFO networking_nsxv3.common.synchronization [req-82a46fce-2cad-4dc0-992c-68559c6bf332 req-87cb6ff5-ce4d-4d69-8c66-2a29ea8d1b69 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 659.965864] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 659.969471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.969789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.969789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.970594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.970594] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.970594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 659.970594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.970594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 659.970594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 659.970594] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.193339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.193509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.193583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.193852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.193948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.194064] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be updated. [ 660.220121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.220272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.220345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.220571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.220719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.228255] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 2s [ 660.381881] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.381965] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-569" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.382165] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-569" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.382580] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-569" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.382847] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.383044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.383172] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.383408] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.383548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.383786] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.383908] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.384028] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.384139] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.384251] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.384363] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.384510] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.402890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.402890] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.403046] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.403144] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-569" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.403434] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.404338] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.404338] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.405342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.405342] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a994020-bb4a-4a3e-9d6e-8646f77a6ed5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.474732] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.474732] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.474732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 already deleted. [ 660.474732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.907535] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.907868] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.907990] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.908268] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.908468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.908645] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 not found, creating... [ 660.909154] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.909154] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.909333] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.913020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.913020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.913020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.913020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.913020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.913020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.913020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.913020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 is going to be created. [ 660.930833] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.930833] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 660.930833] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.931061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 660.931250] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 660.931648] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.027394] env[62815]: INFO networking_nsxv3.common.synchronization [None req-3c49d1ea-1e91-480a-bb70-feb7434a994d None None] Enqueued Resource ID: 148972d9-1cc2-49f8-95e5-c9c11def78ae with Priority: HIGHEST for action port [ 661.028648] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 148972d9-1cc2-49f8-95e5-c9c11def78ae with Priority: HIGHEST for action port [ 661.028969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-148972d9-1cc2-49f8-95e5-c9c11def78ae taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.029513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-148972d9-1cc2-49f8-95e5-c9c11def78ae" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.029589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-148972d9-1cc2-49f8-95e5-c9c11def78ae" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.030082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-148972d9-1cc2-49f8-95e5-c9c11def78ae" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.030181] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('148972d9-1cc2-49f8-95e5-c9c11def78ae',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.534133] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 148972d9-1cc2-49f8-95e5-c9c11def78ae [ 661.534133] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.534133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.534133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.534133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.534133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.534133] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:148972d9-1cc2-49f8-95e5-c9c11def78ae already deleted. [ 661.534133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-148972d9-1cc2-49f8-95e5-c9c11def78ae" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.723694] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 661.723694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.725355] env[62815]: INFO networking_nsxv3.common.synchronization [req-82a46fce-2cad-4dc0-992c-68559c6bf332 req-92bc9b25-94a5-4302-bc30-c492d0d96ad8 service nova] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 661.725590] env[62815]: INFO networking_nsxv3.common.synchronization [req-82a46fce-2cad-4dc0-992c-68559c6bf332 req-92bc9b25-94a5-4302-bc30-c492d0d96ad8 service nova] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 661.726138] env[62815]: INFO networking_nsxv3.common.synchronization [req-82a46fce-2cad-4dc0-992c-68559c6bf332 req-92bc9b25-94a5-4302-bc30-c492d0d96ad8 service nova] Enqueued Resource ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with Priority: HIGHEST for action port [ 661.726138] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 661.726138] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 661.729464] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with Priority: HIGHEST for action port [ 661.729464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.729464] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.729464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.729464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.729464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 661.729464] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.732865] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.732865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.732865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.732865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.732865] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a994020-bb4a-4a3e-9d6e-8646f77a6ed5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.831996] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e3364f35-a62c-460b-b963-70cb3f4a0f48 tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_rules [ 661.831996] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_rules [ 661.831996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.831996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 661.831996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.831996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 661.831996] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.921834] env[62815]: INFO networking_nsxv3.common.synchronization [None req-42767c73-2b30-4fe1-a6d1-9d292dd064a0 tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_rules [ 661.922421] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_rules [ 661.922746] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.922861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.233779] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.233909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.234105] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.235021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with status ACTIVE [ 662.235205] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.235318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.235385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.235585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.235681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.235845] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.235940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.236027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.236172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.236251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.237783] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.238792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.238911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.239116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.239234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.239653] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 is going to be updated. [ 662.242964] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 662.243165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.243590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.243792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.243976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.248030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.248030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.248030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.248030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.248030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.248030] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.271036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.271036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.271036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.271036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.271036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.271036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.359738] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.359738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.359967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.360074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.360163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.360262] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c already deleted. [ 662.360377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.360657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.360725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.360787] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.746672] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.754490] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.754490] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.754490] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.754490] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.754490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.755015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.755015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.755015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.755015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.755015] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.884433] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.884433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 662.884433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.884433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 662.884605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 662.884605] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c already deleted. [ 662.884906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.250129] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.250578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.250578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.250686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.250686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.250789] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be created. [ 663.262782] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73cab825-2378-45d6-b89b-7d11138b2d06: rpc.has_security_group_logging(os_id): False [ 663.272961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.272961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.272961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.272961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.273344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.283991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.284145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.284216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.284422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.284515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.284692] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.284789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.284852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.284999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.285261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.285317] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.285365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.285424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.285564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.285637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.285836] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.285926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.285985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.286140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.286332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.286332] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be updated. [ 663.287980] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: UNINITIALIZED for 2s [ 663.345576] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.345708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.345814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.345994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.346146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.362416] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 2s [ 663.396734] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9a13626c-ddf4-4fb2-baf5-343fe40a502a None None] Enqueued Resource ID: 74f5908d-9162-4c78-81dd-ef0a90ff288a with Priority: HIGHEST for action port [ 663.396990] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f5908d-9162-4c78-81dd-ef0a90ff288a with Priority: HIGHEST for action port [ 663.397621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-74f5908d-9162-4c78-81dd-ef0a90ff288a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.397760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74f5908d-9162-4c78-81dd-ef0a90ff288a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.397844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74f5908d-9162-4c78-81dd-ef0a90ff288a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.398110] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74f5908d-9162-4c78-81dd-ef0a90ff288a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.398195] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f5908d-9162-4c78-81dd-ef0a90ff288a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.900496] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74f5908d-9162-4c78-81dd-ef0a90ff288a [ 663.900584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.900702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 663.900776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.901018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 663.901126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 663.901229] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74f5908d-9162-4c78-81dd-ef0a90ff288a already deleted. [ 663.901316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74f5908d-9162-4c78-81dd-ef0a90ff288a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 664.931444] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2fb9bc47-5dbe-4220-b4bb-342f52f47b52 None None] Enqueued Resource ID: 8b7d92b8-f060-4cf9-a696-5277fe423b41 with Priority: HIGHEST for action port [ 664.931726] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b7d92b8-f060-4cf9-a696-5277fe423b41 with Priority: HIGHEST for action port [ 664.932319] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b7d92b8-f060-4cf9-a696-5277fe423b41 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.932443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b7d92b8-f060-4cf9-a696-5277fe423b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 664.932513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b7d92b8-f060-4cf9-a696-5277fe423b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.932777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b7d92b8-f060-4cf9-a696-5277fe423b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 664.932861] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b7d92b8-f060-4cf9-a696-5277fe423b41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.298179] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: SUCCESS [ 665.298405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.298577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.298801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.298992] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.299126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.299192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.299367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.299450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.299538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.299627] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.375451] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 665.375451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.398073] env[62815]: INFO networking_nsxv3.common.synchronization [req-8528cdbe-de35-4b3d-a023-512c7813f3bf req-7f3d554e-e84b-4fb8-ac0d-e1c688354d27 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 665.398615] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 665.398913] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.399047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.399115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.399440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.399549] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.399649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.400247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.400247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.400247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.401340] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.434707] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b7d92b8-f060-4cf9-a696-5277fe423b41 [ 665.434928] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.435070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.435135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.435337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.435432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.437803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b7d92b8-f060-4cf9-a696-5277fe423b41 already deleted. [ 665.437803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b7d92b8-f060-4cf9-a696-5277fe423b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.805537] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.905307] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.905429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.905476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.905697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.905793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.906012] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.906152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 665.906215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.906383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 665.906461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 665.907378] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 already deleted. [ 665.907378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.103742] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.103742] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.103742] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.104150] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.107768] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.107978] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.108141] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.108451] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.108615] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.108847] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.109121] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.109121] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.113333] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.113333] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.113333] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.113333] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.134258] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.134454] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.134608] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.134799] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.135204] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-8d88f392-f8fd-4108-b191-bb8156946ddb taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.135324] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.135446] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.135793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.135937] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d88f392-f8fd-4108-b191-bb8156946ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.307061] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 901c46e1-fd02-475c-b557-4e4b01c2fc14: rpc.has_security_group_logging(os_id): False [ 666.327178] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.327178] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.327178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.327178] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be created. [ 666.386927] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.386927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.386927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.386927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.386927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.396794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: IN_PROGRESS for 2s [ 666.640157] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.640157] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.640157] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.640157] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.640670] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.640757] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 8d88f392-f8fd-4108-b191-bb8156946ddb not found, creating... [ 666.641086] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.641359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.641544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.641873] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.642038] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.642392] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.642636] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.642896] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.643116] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.643318] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.643514] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 8d88f392-f8fd-4108-b191-bb8156946ddb is going to be created. [ 666.664407] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.664665] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.664795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.665085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.665313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.665545] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 666.821488] env[62815]: INFO networking_nsxv3.common.synchronization [None req-4e8fecd4-698d-42f3-87f1-978ed25121dd None None] Enqueued Resource ID: db96acdf-61df-453d-9bd0-4d7346a59e90 with Priority: HIGHEST for action port [ 666.821812] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db96acdf-61df-453d-9bd0-4d7346a59e90 with Priority: HIGHEST for action port [ 666.822428] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-db96acdf-61df-453d-9bd0-4d7346a59e90 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.822561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db96acdf-61df-453d-9bd0-4d7346a59e90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 666.822628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db96acdf-61df-453d-9bd0-4d7346a59e90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.822919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db96acdf-61df-453d-9bd0-4d7346a59e90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 666.822997] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db96acdf-61df-453d-9bd0-4d7346a59e90',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.325641] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db96acdf-61df-453d-9bd0-4d7346a59e90 [ 667.325641] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.325971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.325971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.326149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.326199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.327100] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db96acdf-61df-453d-9bd0-4d7346a59e90 already deleted. [ 667.327100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db96acdf-61df-453d-9bd0-4d7346a59e90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.502022] env[62815]: INFO networking_nsxv3.common.synchronization [req-8528cdbe-de35-4b3d-a023-512c7813f3bf req-07988e42-c95d-422f-a7bd-9ed6f01c8e46 service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 667.502022] env[62815]: INFO networking_nsxv3.common.synchronization [req-8528cdbe-de35-4b3d-a023-512c7813f3bf req-07988e42-c95d-422f-a7bd-9ed6f01c8e46 service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 667.502022] env[62815]: INFO networking_nsxv3.common.synchronization [req-8528cdbe-de35-4b3d-a023-512c7813f3bf req-07988e42-c95d-422f-a7bd-9ed6f01c8e46 service nova] Enqueued Resource ID: 8d88f392-f8fd-4108-b191-bb8156946ddb with Priority: HIGHEST for action port [ 667.502022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 667.502022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 667.502022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d88f392-f8fd-4108-b191-bb8156946ddb with Priority: HIGHEST for action port [ 667.502022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.502022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.502022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.502022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.502022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.502922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.502922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 667.502922] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.504263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d88f392-f8fd-4108-b191-bb8156946ddb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.504364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 667.504427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.504645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 667.504645] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d88f392-f8fd-4108-b191-bb8156946ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.007016] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.008170] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.008244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.008370] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d88f392-f8fd-4108-b191-bb8156946ddb with status ACTIVE [ 668.008545] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.008652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.008719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.008922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.009041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.009281] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.009281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.009439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.009518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.009619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.009784] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.009875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.009936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.010211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.010293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.010396] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d88f392-f8fd-4108-b191-bb8156946ddb is going to be updated. [ 668.173471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.173647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 668.173710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.173940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 668.174083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.174536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d88f392-f8fd-4108-b191-bb8156946ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.407751] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: SUCCESS [ 668.408155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 668.512554] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.016447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.016447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.016447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.016628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.016685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.016788] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be created. [ 669.043549] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.043717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.043761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.043999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.044173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.052922] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: UNINITIALIZED for 2s [ 669.653818] env[62815]: INFO networking_nsxv3.common.synchronization [req-58bb553e-b841-4fee-96c0-06b8ba66594a req-a82514bb-ae88-470a-b5b8-55f80578530c tempest-DeleteServersAdminTestJSON-1887008233 tempest-DeleteServersAdminTestJSON-1887008233-project-member] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 669.654594] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGHEST for action security_group_members [ 669.654917] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.658711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.658711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.658711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.659464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.659659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.659755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.659947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.661185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.661508] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.931962] env[62815]: INFO networking_nsxv3.common.synchronization [req-ecdee767-d0bc-49ae-9fb1-17345270a538 req-7b41bded-71e1-4942-a788-624f7bfbb71e tempest-ServersTestBootFromVolume-393267422 tempest-ServersTestBootFromVolume-393267422-project-member] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_members [ 669.931962] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_members [ 669.931962] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.931962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.931962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.932876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.932876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.932876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 669.932876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.933190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 669.933190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 669.933263] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.166208] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.166208] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.166208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.166208] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be updated. [ 670.190403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.190403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.190403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.190403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.190403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.196581] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: IN_PROGRESS for 2s [ 670.435988] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.436166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.436234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.436454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.436546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.436745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.436835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.436902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.437109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.437205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.437308] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b already deleted. [ 670.437405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.532055] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.532261] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-793" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.532496] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-793" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.532725] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-793" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.532977] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.533156] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.533277] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.533495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.533646] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.533995] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.534121] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.534230] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.534336] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.534446] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.534552] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.534685] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.554151] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.554339] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.554492] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.554684] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-793" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 670.555012] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-6da3c3d0-e8b5-4883-8c60-f99be774eef3 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.555193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 670.555314] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.555634] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 670.555779] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6da3c3d0-e8b5-4883-8c60-f99be774eef3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.058432] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.058793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.058793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.059060] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.059220] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.059426] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 6da3c3d0-e8b5-4883-8c60-f99be774eef3 not found, creating... [ 671.059670] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.059827] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.059943] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.060181] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.060318] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.060617] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.060772] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.060899] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.061145] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.061284] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.061425] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 6da3c3d0-e8b5-4883-8c60-f99be774eef3 is going to be created. [ 671.063081] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 671.063266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.063785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.063949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.064115] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.064213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.064274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.064412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.064490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.064570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.064653] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.081991] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.082400] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 671.082400] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.083069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 671.083362] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.083670] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 671.566488] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.072130] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2840bf9-b592-4644-bcf1-bd4ca72a79e5: rpc.has_security_group_logging(os_id): False [ 672.092265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.092453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.092535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.092792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.093248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.093553] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.093723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.093761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.094080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.094194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.094316] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be created. [ 672.154500] env[62815]: INFO networking_nsxv3.common.synchronization [req-ecdee767-d0bc-49ae-9fb1-17345270a538 req-80831d0e-6774-45ef-ae0a-32186053bc51 service nova] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_rules [ 672.154931] env[62815]: INFO networking_nsxv3.common.synchronization [req-ecdee767-d0bc-49ae-9fb1-17345270a538 req-80831d0e-6774-45ef-ae0a-32186053bc51 service nova] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_members [ 672.155215] env[62815]: INFO networking_nsxv3.common.synchronization [req-ecdee767-d0bc-49ae-9fb1-17345270a538 req-80831d0e-6774-45ef-ae0a-32186053bc51 service nova] Enqueued Resource ID: 6da3c3d0-e8b5-4883-8c60-f99be774eef3 with Priority: HIGHEST for action port [ 672.157161] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_rules [ 672.159291] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_members [ 672.159291] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6da3c3d0-e8b5-4883-8c60-f99be774eef3 with Priority: HIGHEST for action port [ 672.159291] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.159291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.159291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.159291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.159291] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.160213] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.160323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.160389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.160662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.160817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.160915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.160975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.161146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.161228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.161320] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.162143] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6da3c3d0-e8b5-4883-8c60-f99be774eef3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.162269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.163040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.163040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.163040] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6da3c3d0-e8b5-4883-8c60-f99be774eef3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.178697] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.178697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.178697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.178697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.178697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.194124] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 672.206134] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73cab825-2378-45d6-b89b-7d11138b2d06 in Status: SUCCESS [ 672.206134] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 deletion is rescheduled due to dependency. [ 672.206134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.663295] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.663295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.665449] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6da3c3d0-e8b5-4883-8c60-f99be774eef3 with status ACTIVE [ 672.665652] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.665777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.665849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.666064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.666149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.667022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.667022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.667022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.667022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.667022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.667022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.667022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.667022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.667507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.667507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.667507] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6da3c3d0-e8b5-4883-8c60-f99be774eef3 is going to be updated. [ 672.668437] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.688041] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.688186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 672.688254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.688475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 672.688615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 672.688768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6da3c3d0-e8b5-4883-8c60-f99be774eef3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.172036] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.674815] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.674973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.675053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.675272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.675365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.675457] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b is going to be created. [ 673.697107] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.697360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 673.697480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.697775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 673.698035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 673.709815] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: UNINITIALIZED for 2s [ 674.205380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 674.206117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.721044] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: SUCCESS [ 675.721044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.721044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.721044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.721044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.721763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 675.721763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.721763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 675.721763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.721763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 675.721763] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.226012] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.730191] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d9dce03-d37e-4edb-85ab-d71157c4485b: rpc.has_security_group_logging(os_id): False [ 676.754741] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.754889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 676.755406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.755406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 676.755406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.755561] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.755621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 676.755680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.755830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 676.755924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.756024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b is going to be created. [ 676.819041] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.819041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 676.819041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.819041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 676.819041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 676.831335] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: IN_PROGRESS for 2s [ 677.160402] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 677.160568] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 677.416375] env[62815]: INFO networking_nsxv3.common.synchronization [req-57b842bb-694c-4986-a180-3802dd4843fd req-12b84ca7-a6b3-4354-91f6-a6a3cabc105a tempest-ServersWithSpecificFlavorTestJSON-887013430 tempest-ServersWithSpecificFlavorTestJSON-887013430-project-member] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 677.416375] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 677.416375] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.416375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.416375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.416375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.416375] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.416375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.417078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.417078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.417078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.417078] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.921022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.921525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.921525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.921525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.921723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.921839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.921939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.921996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.922164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.922245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.922330] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be updated. [ 677.951176] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.951176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 677.951176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.951707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 677.951990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 677.963621] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 678.843151] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: SUCCESS [ 678.843442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.200018] env[62815]: INFO networking_nsxv3.common.synchronization [req-3b2f6e11-ac62-4364-b40c-6a52fe22e2b3 req-045c0256-e85d-41c9-bb77-26230c6cf9a4 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 679.200714] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 679.200933] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.201075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.201141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.201347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.201495] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.201592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.201654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.201820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.201905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.202009] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.691888] env[62815]: INFO networking_nsxv3.common.synchronization [None req-207b2a60-5200-4582-b1c4-39d23a149dee None None] Enqueued Resource ID: 8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688 with Priority: HIGHEST for action port [ 679.692026] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688 with Priority: HIGHEST for action port [ 679.692609] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.692728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.692799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.693630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.693692] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.704904] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.814088] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.814336] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.814431] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.814848] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.815039] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.815193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.815297] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.815580] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.815670] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.815936] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.816158] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.816158] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.816456] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.816456] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.816456] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.816626] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.840076] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.840076] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.840305] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.840483] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 679.840822] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-45994ec3-7b75-431e-aa4c-8da142993e18 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.841356] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 679.841356] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.841755] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 679.841755] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45994ec3-7b75-431e-aa4c-8da142993e18',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.972925] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 679.972925] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 deletion is rescheduled due to dependency. [ 679.972925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.196300] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688 [ 680.196689] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.196994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.197997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.198334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.198518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.198715] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688 already deleted. [ 680.201278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cb2a81c-3c96-4cc1-b5f4-c661e5ce6688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.207314] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.348958] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.349322] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.349729] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.349862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.350100] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.351193] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 45994ec3-7b75-431e-aa4c-8da142993e18 not found, creating... [ 680.351193] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.351193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.351193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.351193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.352058] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.352058] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.352058] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.352239] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.352463] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.352641] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.352821] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 45994ec3-7b75-431e-aa4c-8da142993e18 is going to be created. [ 680.372538] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.372845] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.372993] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.373277] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.373635] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.373755] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.709084] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.709240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.709311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.709547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.709646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.709744] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 680.739360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.739798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 680.740034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.740375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 680.740663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 680.749688] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 681.281582] env[62815]: INFO networking_nsxv3.common.synchronization [None req-587e0a5d-a4df-4f6e-8410-275e81829427 None None] Enqueued Resource ID: cfac6fa2-c98f-4684-9e0c-28e4b3477a6d with Priority: HIGHEST for action port [ 681.284838] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfac6fa2-c98f-4684-9e0c-28e4b3477a6d with Priority: HIGHEST for action port [ 681.284838] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfac6fa2-c98f-4684-9e0c-28e4b3477a6d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.284838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfac6fa2-c98f-4684-9e0c-28e4b3477a6d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.284838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfac6fa2-c98f-4684-9e0c-28e4b3477a6d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.284838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfac6fa2-c98f-4684-9e0c-28e4b3477a6d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.284838] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfac6fa2-c98f-4684-9e0c-28e4b3477a6d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.559022] env[62815]: INFO networking_nsxv3.common.synchronization [req-3b2f6e11-ac62-4364-b40c-6a52fe22e2b3 req-0d2cc370-37ff-4c5a-8bbc-5d9c5c8aea8c service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 681.559022] env[62815]: INFO networking_nsxv3.common.synchronization [req-3b2f6e11-ac62-4364-b40c-6a52fe22e2b3 req-0d2cc370-37ff-4c5a-8bbc-5d9c5c8aea8c service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 681.559022] env[62815]: INFO networking_nsxv3.common.synchronization [req-3b2f6e11-ac62-4364-b40c-6a52fe22e2b3 req-0d2cc370-37ff-4c5a-8bbc-5d9c5c8aea8c service nova] Enqueued Resource ID: 45994ec3-7b75-431e-aa4c-8da142993e18 with Priority: HIGHEST for action port [ 681.559022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 681.559022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 681.559022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45994ec3-7b75-431e-aa4c-8da142993e18 with Priority: HIGHEST for action port [ 681.559376] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.559438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.559467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.559973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.559973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.561027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.561162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.561417] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-45994ec3-7b75-431e-aa4c-8da142993e18 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.561534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.561602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.561792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.561869] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45994ec3-7b75-431e-aa4c-8da142993e18',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.787762] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfac6fa2-c98f-4684-9e0c-28e4b3477a6d [ 681.787762] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.787762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 681.787762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.787762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 681.787762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 681.787762] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfac6fa2-c98f-4684-9e0c-28e4b3477a6d already deleted. [ 681.787762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfac6fa2-c98f-4684-9e0c-28e4b3477a6d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.030147] env[62815]: INFO networking_nsxv3.common.synchronization [req-f65abb5d-a1b6-4860-a488-cfe420a1e99c req-dcd93a8c-a4e7-4731-81bb-7b3d4beac39c tempest-ServerAddressesTestJSON-579514420 tempest-ServerAddressesTestJSON-579514420-project-member] Enqueued Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_members [ 682.030147] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_members [ 682.030147] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.030147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.030147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.030147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.030147] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.034310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.034404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.034580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.034673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.034776] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.064456] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.064456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.072197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45994ec3-7b75-431e-aa4c-8da142993e18 with status ACTIVE [ 682.072197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.072197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.072197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.072197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.072197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45994ec3-7b75-431e-aa4c-8da142993e18 is going to be updated. [ 682.094725] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.094911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.094964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.095189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.095371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.095488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45994ec3-7b75-431e-aa4c-8da142993e18" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.342718] env[62815]: INFO networking_nsxv3.common.synchronization [None req-06f4362d-6538-4c1e-961a-e27602c05308 None None] Enqueued Resource ID: 654d9c34-af59-47a0-84aa-8c20a183b482 with Priority: HIGHEST for action port [ 682.344864] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654d9c34-af59-47a0-84aa-8c20a183b482 with Priority: HIGHEST for action port [ 682.345791] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-654d9c34-af59-47a0-84aa-8c20a183b482 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.345791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-654d9c34-af59-47a0-84aa-8c20a183b482" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.345791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-654d9c34-af59-47a0-84aa-8c20a183b482" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.345791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-654d9c34-af59-47a0-84aa-8c20a183b482" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.345791] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654d9c34-af59-47a0-84aa-8c20a183b482',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.539851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.540031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.540107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.540384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.540520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.540788] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.540893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.540987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.541267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.541267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.541329] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 already deleted. [ 682.541400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.700235] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.700235] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-626" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.700235] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-626" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.700235] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-626" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.700439] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.700675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.700675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.700923] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.701085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.701371] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.701528] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.701691] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.701752] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.701871] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.701975] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.702149] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.723601] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.723601] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.723601] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.723601] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-626" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.723601] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.723601] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.723601] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.723601] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.723601] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.760406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 682.760745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.761402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.761709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.761974] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.762149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.762239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.762443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.762568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.762706] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.849361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 654d9c34-af59-47a0-84aa-8c20a183b482 [ 682.849649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.849796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 682.849870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.850220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 682.850220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 682.850324] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:654d9c34-af59-47a0-84aa-8c20a183b482 already deleted. [ 682.850409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-654d9c34-af59-47a0-84aa-8c20a183b482" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.225943] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.226221] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.226475] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.226634] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.226811] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.226985] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df not found, creating... [ 683.227286] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.227470] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.227637] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.227942] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.228202] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.228710] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.228710] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.228903] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.229376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.229730] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.229830] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df is going to be created. [ 683.267681] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.273395] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.273395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 683.273395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.273395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 683.273395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.273395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 683.771289] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.065427] env[62815]: INFO networking_nsxv3.common.synchronization [req-f65abb5d-a1b6-4860-a488-cfe420a1e99c req-02d674e7-6487-4050-9016-ba725c57dce4 service nova] Enqueued Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_rules [ 684.066689] env[62815]: INFO networking_nsxv3.common.synchronization [req-f65abb5d-a1b6-4860-a488-cfe420a1e99c req-02d674e7-6487-4050-9016-ba725c57dce4 service nova] Enqueued Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_members [ 684.066689] env[62815]: INFO networking_nsxv3.common.synchronization [req-f65abb5d-a1b6-4860-a488-cfe420a1e99c req-02d674e7-6487-4050-9016-ba725c57dce4 service nova] Enqueued Resource ID: 2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df with Priority: HIGHEST for action port [ 684.066689] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_rules [ 684.066689] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_members [ 684.067016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df with Priority: HIGHEST for action port [ 684.069527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.069527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.069527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.069527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.069527] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.069527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.071060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.071060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.071060] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.071956] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.072543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.072668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.072857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.073538] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.277948] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.277948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.277948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.278169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.278268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.278378] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 684.306499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.306639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.306705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.306926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.307601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.316275] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 684.330387] env[62815]: INFO networking_nsxv3.common.synchronization [None req-95138c16-903e-44b2-9c1c-31eafa803331 None None] Enqueued Resource ID: 940c0be8-44fc-4bd8-a8d3-2866e3464dd0 with Priority: HIGHEST for action port [ 684.330650] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940c0be8-44fc-4bd8-a8d3-2866e3464dd0 with Priority: HIGHEST for action port [ 684.331241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-940c0be8-44fc-4bd8-a8d3-2866e3464dd0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.331364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940c0be8-44fc-4bd8-a8d3-2866e3464dd0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.331452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940c0be8-44fc-4bd8-a8d3-2866e3464dd0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.331676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940c0be8-44fc-4bd8-a8d3-2866e3464dd0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.331761] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940c0be8-44fc-4bd8-a8d3-2866e3464dd0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.575348] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.575483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.576040] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.576576] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df with status ACTIVE [ 684.576748] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.576857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.576918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.577133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.577221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.577379] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.577474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.577536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.577656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.577726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.577894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.577990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.581559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.581559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.581559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.581559] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df is going to be updated. [ 684.600917] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.601064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.601134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.601342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.601473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.601762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a2bba7c-1b92-4eb7-a130-2bb19b7ae9df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.834559] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 940c0be8-44fc-4bd8-a8d3-2866e3464dd0 [ 684.836152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.836321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 684.839020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.839020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 684.839020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 684.839020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:940c0be8-44fc-4bd8-a8d3-2866e3464dd0 already deleted. [ 684.839020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940c0be8-44fc-4bd8-a8d3-2866e3464dd0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.082424] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.585112] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.585282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.585355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.585590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.585701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.585806] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 is going to be created. [ 685.612051] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.612051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 685.612051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.612051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 685.612051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 685.622056] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 in Status: UNINITIALIZED for 2s [ 686.325943] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 686.326304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.326361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.326576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.326812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.327730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.327730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.327730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.327730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.327730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.327730] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.831068] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.831418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.831464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.831677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.831882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.831982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.832062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.832213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.832304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.832401] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.832600] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.832646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.832674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.832807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.832943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.833042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 686.833103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.833235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 686.833311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.833389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 686.833476] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.335519] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 687.354322] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.354322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.354322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.354322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.354590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.354590] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.354665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.354733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.354901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.355067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.355193] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.355734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.355734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.355734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.355734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.355854] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.355854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.355933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.356065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.356157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.356252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 687.420371] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.420533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.420594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.420988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.421160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.434405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 687.632667] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 in Status: SUCCESS [ 687.632667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.632667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.633415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.633752] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.634102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 687.634645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.634645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 687.634645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.634971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 687.635490] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.138386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.138633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.138696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.138962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.139191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.139335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.139431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.139668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.139808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.139898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.140099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.140229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.140319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.140510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.140703] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.140835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.140936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.141140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.141248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.141362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.141482] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.643994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4eb0fce-410c-49a9-858d-6d903b2d7c99: rpc.has_security_group_logging(os_id): False [ 688.661778] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.661989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.662078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.662292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.662382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.662575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.662661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.662725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.662868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.662998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.663152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.663244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.663305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.663440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.663515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.663700] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.663809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.663842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.664011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.664047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.664123] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 is going to be created. [ 688.718907] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.719094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 688.719170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.719486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 688.719665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 688.730584] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 in Status: IN_PROGRESS for 2s [ 689.331774] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 689.331774] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 689.449294] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 689.449426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.266248] env[62815]: INFO networking_nsxv3.common.synchronization [req-e0d6de13-13d5-47d0-bc38-fae2a244f9cc req-ef87a539-b8b6-4b38-88a5-9c69db09617f tempest-ListImageFiltersTestJSON-1830437384 tempest-ListImageFiltersTestJSON-1830437384-project-member] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 690.266680] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 690.266972] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.271017] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 690.271017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.271017] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.747021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 in Status: SUCCESS [ 690.747021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 690.770928] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.272237] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.775957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.775957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.775957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.776539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.776539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.777012] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be updated. [ 691.808579] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.808747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.808835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.809068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.809450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.817335] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: IN_PROGRESS for 2s [ 691.981510] env[62815]: INFO networking_nsxv3.common.synchronization [req-d48fd85f-a7b3-40f1-806b-4a57760f86e9 req-30ff7966-9dbb-46b9-a93d-ad16848c4fc4 tempest-ServersTestJSON-2023342580 tempest-ServersTestJSON-2023342580-project-member] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_members [ 691.981510] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGHEST for action security_group_members [ 691.981736] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.981736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.981826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.982155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.982404] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.982485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.982485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.982648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.982753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.982850] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.121088] env[62815]: INFO networking_nsxv3.common.synchronization [req-5220852b-a44f-4a8f-8e5f-c2526985310e req-cbbd2991-ed26-4707-a0fc-7b0c5d59099a tempest-ServersAdminNegativeTestJSON-39006248 tempest-ServersAdminNegativeTestJSON-39006248-project-member] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 692.121154] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 692.121599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.121599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.121599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.121850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.122008] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.122404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.122465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.122652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.122929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.122929] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.363890] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e86debb1-eba2-4dc8-a7eb-51f11834ff4a None None] Enqueued Resource ID: 33810bb3-fefc-4799-b667-11797fd85189 with Priority: HIGHEST for action port [ 692.364150] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33810bb3-fefc-4799-b667-11797fd85189 with Priority: HIGHEST for action port [ 692.364616] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-33810bb3-fefc-4799-b667-11797fd85189 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.364733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33810bb3-fefc-4799-b667-11797fd85189" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.364797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33810bb3-fefc-4799-b667-11797fd85189" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.365121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33810bb3-fefc-4799-b667-11797fd85189" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.365204] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33810bb3-fefc-4799-b667-11797fd85189',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.487724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.487724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.487724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.487724] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 is going to be updated. [ 692.512874] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.513613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.513613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.513613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.513769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.524025] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.525198] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.525198] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.525895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.526309] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.526309] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.527652] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.527652] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.527652] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.527652] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.527652] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.527652] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.527807] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.527807] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.528024] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.529339] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.533166] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 in Status: IN_PROGRESS for 2s [ 692.546757] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.546927] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.547088] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.547263] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.547598] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2d36e8e5-c29d-490c-88c1-32af31dbc473 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.547793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.547916] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.548258] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.548403] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d36e8e5-c29d-490c-88c1-32af31dbc473',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.625763] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.625904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.625978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.626216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.626311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.626506] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.626602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.626666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.626809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.626883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.627069] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f already deleted. [ 692.627140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.867915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33810bb3-fefc-4799-b667-11797fd85189 [ 692.868491] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.868690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.868787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.868974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.869076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.869181] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33810bb3-fefc-4799-b667-11797fd85189 already deleted. [ 692.869360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33810bb3-fefc-4799-b667-11797fd85189" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.051488] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.051488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.051488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.052946] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.052946] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.052946] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2d36e8e5-c29d-490c-88c1-32af31dbc473 not found, creating... [ 693.053100] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.053176] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.053265] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.053508] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.053647] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.053939] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.054105] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.054219] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.054433] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.054564] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.054710] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2d36e8e5-c29d-490c-88c1-32af31dbc473 is going to be created. [ 693.074437] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.074645] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.074835] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.075102] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.080084] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.080084] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.091419] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f332d2a9-f54c-4cab-a91e-e103c4aa38d8 tempest-ServersTestManualDisk-455940675 tempest-ServersTestManualDisk-455940675-project-member] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_rules [ 693.091969] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_rules [ 693.092804] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.092804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.092804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.092804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.092804] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.225668] env[62815]: INFO networking_nsxv3.common.synchronization [None req-19824f4a-27f7-4dc2-82af-7be352fa9954 tempest-ServersTestManualDisk-455940675 tempest-ServersTestManualDisk-455940675-project-member] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_rules [ 693.226234] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_rules [ 693.226517] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.226623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.615541] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.615864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.615864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.615988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.616057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.616164] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 already deleted. [ 693.616255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.616373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.616522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.620494] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.828153] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 693.828370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.935708] env[62815]: INFO networking_nsxv3.common.synchronization [req-b42890ec-7eb7-42bb-9e92-a6c8a3520ef3 req-40b2c21d-344d-4384-ab29-53f33d6b0b98 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 693.936129] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 693.936413] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.936534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.936602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.936844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.936968] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.938202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 693.938202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.938794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 693.938794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 693.938794] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.064062] env[62815]: INFO networking_nsxv3.common.synchronization [req-5220852b-a44f-4a8f-8e5f-c2526985310e req-39f30d35-8992-4859-83ce-426c7393b027 service nova] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_rules [ 694.067020] env[62815]: INFO networking_nsxv3.common.synchronization [req-5220852b-a44f-4a8f-8e5f-c2526985310e req-39f30d35-8992-4859-83ce-426c7393b027 service nova] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 694.067020] env[62815]: INFO networking_nsxv3.common.synchronization [req-5220852b-a44f-4a8f-8e5f-c2526985310e req-39f30d35-8992-4859-83ce-426c7393b027 service nova] Enqueued Resource ID: 2d36e8e5-c29d-490c-88c1-32af31dbc473 with Priority: HIGHEST for action port [ 694.067020] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_rules [ 694.067020] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 694.067020] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d36e8e5-c29d-490c-88c1-32af31dbc473 with Priority: HIGHEST for action port [ 694.068205] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.068339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.068449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.068717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.068799] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.071216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.071343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.071410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.071592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.071737] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.072101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.072165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.074018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.074018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.074018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.074018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d36e8e5-c29d-490c-88c1-32af31dbc473 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.074018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.074018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.074018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.074018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d36e8e5-c29d-490c-88c1-32af31dbc473',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.089268] env[62815]: INFO networking_nsxv3.common.synchronization [req-63c8c974-fc8c-4d54-bb5c-681ea58bc8c7 req-99f49423-bd73-4954-b587-232852dfab13 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 694.089764] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 694.090516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.090618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.090656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.090893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.093331] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.094377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.094377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.094377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.094377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.094377] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.139866] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.140046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.140099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.140307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.140396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.140524] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 already deleted. [ 694.140591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.445532] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.499110] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.499625] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.499964] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.500430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.500899] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.504111] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.504111] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.504111] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.504111] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.504111] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.504111] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.504111] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.504111] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.504111] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.504111] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.504111] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.523385] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.523385] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.523543] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.523743] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.524093] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.524274] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.524395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.524718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.524859] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5638f35-6717-4cf5-b8b5-cffe3b980cd1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.542758] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 in Status: SUCCESS [ 694.542973] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 deletion is rescheduled due to dependency. [ 694.543132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.575889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.575889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.575889] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.576566] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d36e8e5-c29d-490c-88c1-32af31dbc473 with status ACTIVE [ 694.576681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.576851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.576851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.577078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.577176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.577349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.577445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.577519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.577764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.577853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.578227] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.578373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.578464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.578710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.578840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.579241] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d36e8e5-c29d-490c-88c1-32af31dbc473 is going to be updated. [ 694.596183] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.596408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.596491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.596708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.596799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.596998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.597118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.597180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.598015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.598147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.598271] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 already deleted. [ 694.598372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.599446] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.599560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.599630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.599826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.599921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.600169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d36e8e5-c29d-490c-88c1-32af31dbc473" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.792955] env[62815]: INFO networking_nsxv3.common.synchronization [None req-cf7e3075-ea21-4797-95ee-6e08798f54be None None] Enqueued Resource ID: 25479f8f-0556-42d3-915e-de5eae613b57 with Priority: HIGHEST for action port [ 694.793870] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25479f8f-0556-42d3-915e-de5eae613b57 with Priority: HIGHEST for action port [ 694.795274] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-25479f8f-0556-42d3-915e-de5eae613b57 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.795274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25479f8f-0556-42d3-915e-de5eae613b57" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.795274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25479f8f-0556-42d3-915e-de5eae613b57" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.795274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25479f8f-0556-42d3-915e-de5eae613b57" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.795274] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25479f8f-0556-42d3-915e-de5eae613b57',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.947271] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.029582] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.029582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.029582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.029582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.029582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.029582] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port b5638f35-6717-4cf5-b8b5-cffe3b980cd1 not found, creating... [ 695.030718] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.030718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.030718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.030718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.030718] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.031049] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.031205] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.031325] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.031694] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.031795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.031970] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: b5638f35-6717-4cf5-b8b5-cffe3b980cd1 is going to be created. [ 695.050317] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.050539] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.051040] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.051040] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.051215] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.051478] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.080935] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.298178] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25479f8f-0556-42d3-915e-de5eae613b57 [ 695.298178] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.298178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.298178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.298178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.298178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.298178] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25479f8f-0556-42d3-915e-de5eae613b57 already deleted. [ 695.298178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25479f8f-0556-42d3-915e-de5eae613b57" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.449194] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.449354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.449920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.449920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.449920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.449920] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 695.476956] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.477115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.477187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.477394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.477535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.485158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 695.587340] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.587501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.587572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.587826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.587921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.588029] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be created. [ 695.611752] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.611752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.611752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.612075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.612124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.620687] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: UNINITIALIZED for 2s [ 695.777977] env[62815]: INFO networking_nsxv3.common.synchronization [req-8f5918dd-ea7d-4ade-889b-04ac5cfde303 req-56946da2-ff93-4183-a7fe-694971bab301 tempest-VolumesAssistedSnapshotsTest-852815796 tempest-VolumesAssistedSnapshotsTest-852815796-project-member] Enqueued Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_members [ 695.778847] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 with Priority: HIGHEST for action security_group_members [ 695.779020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-df11bad1-7d19-47ba-9b6a-8f12d59d5612 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.779467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.779467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.779690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.780331] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.780331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.780331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.780331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.780331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.780555] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df11bad1-7d19-47ba-9b6a-8f12d59d5612',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.830225] env[62815]: INFO networking_nsxv3.common.synchronization [req-63c8c974-fc8c-4d54-bb5c-681ea58bc8c7 req-4cb1c7c7-5004-4cc8-b17c-d74d29f8eb5a service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 695.830498] env[62815]: INFO networking_nsxv3.common.synchronization [req-63c8c974-fc8c-4d54-bb5c-681ea58bc8c7 req-4cb1c7c7-5004-4cc8-b17c-d74d29f8eb5a service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 695.830637] env[62815]: INFO networking_nsxv3.common.synchronization [req-63c8c974-fc8c-4d54-bb5c-681ea58bc8c7 req-4cb1c7c7-5004-4cc8-b17c-d74d29f8eb5a service nova] Enqueued Resource ID: b5638f35-6717-4cf5-b8b5-cffe3b980cd1 with Priority: HIGHEST for action port [ 695.831150] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 695.831325] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 695.831454] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5638f35-6717-4cf5-b8b5-cffe3b980cd1 with Priority: HIGHEST for action port [ 695.832223] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.832223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.832223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.832632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.832812] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.833536] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.833685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.833713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.833879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.834036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.834132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.834193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.834352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.834403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 695.834496] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.835404] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.835504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 695.835570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.835717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 695.835787] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5638f35-6717-4cf5-b8b5-cffe3b980cd1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.168221] env[62815]: INFO networking_nsxv3.common.synchronization [req-2937efa9-498a-4cd2-ab5f-0491561269b7 req-6e250281-b9db-4eb8-8ce4-448d57a0e423 tempest-ServerAddressesTestJSON-579514420 tempest-ServerAddressesTestJSON-579514420-project-member] Enqueued Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_members [ 696.168770] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 with Priority: HIGHEST for action security_group_members [ 696.169138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4eb0fce-410c-49a9-858d-6d903b2d7c99 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.169263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.169263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.169448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.169601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.169721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.169774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.169927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.170209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.170335] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4eb0fce-410c-49a9-858d-6d903b2d7c99',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.285965] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.288182] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.288182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.288182] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 is going to be updated. [ 696.315125] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.315262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.315347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.315596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.315753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.324926] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 in Status: IN_PROGRESS for 2s [ 696.338007] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.339097] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.339247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.339721] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5638f35-6717-4cf5-b8b5-cffe3b980cd1 with status ACTIVE [ 696.339918] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.340104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.340195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.340415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.340530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.340725] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.340850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.340932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.341125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.341263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.341439] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.341574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.341656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.341826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.341991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.342128] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5638f35-6717-4cf5-b8b5-cffe3b980cd1 is going to be updated. [ 696.364398] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.365130] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.365268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.365509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.365655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.365829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5638f35-6717-4cf5-b8b5-cffe3b980cd1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.672642] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.672805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.672877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.673104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.673198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.673392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.673491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.673556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.673795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.673881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.674224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 is going to be updated. [ 696.697683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.697779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 696.697826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.698049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 696.698565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 696.708019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 in Status: IN_PROGRESS for 2s [ 696.841085] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.343965] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.344179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.344288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.344517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.344609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.344785] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be created. [ 697.367582] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.367767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.367844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.368077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.368279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.377786] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: UNINITIALIZED for 2s [ 697.495610] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 697.495836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.630344] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 697.630541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.630706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.630923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.631118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.631235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 697.631301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.631451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 697.631536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.631620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 697.631710] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.133793] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.134308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.134308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.135380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.135380] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.135380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.135380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.135380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.135380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.135380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.135380] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.135883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.135883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.135883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.135883] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.135883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.136133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.136337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.136337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.136456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.136595] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.335455] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 in Status: SUCCESS [ 698.335455] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df11bad1-7d19-47ba-9b6a-8f12d59d5612 deletion is rescheduled due to dependency. [ 698.335455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df11bad1-7d19-47ba-9b6a-8f12d59d5612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.639465] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1a1399f-aaa7-4450-b8eb-595b8dff6f2f: rpc.has_security_group_logging(os_id): False [ 698.658461] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.658603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.658603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.659388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.659388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.659388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.659388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.659388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.659388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.659601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.659601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.659749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.659781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.662014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.662014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.662014] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.662014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.662014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.662014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.662014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.662014] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be created. [ 698.719761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.719907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 698.719974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.720200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 698.720667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.722020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 in Status: SUCCESS [ 698.722203] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4eb0fce-410c-49a9-858d-6d903b2d7c99 deletion is rescheduled due to dependency. [ 698.722499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4eb0fce-410c-49a9-858d-6d903b2d7c99" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 698.743672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 699.388252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 699.388514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.388631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.388856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.389059] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.389180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.389247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.389406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.389489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.389574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.389726] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.892336] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.892501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.892582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.892785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.896324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.896455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.896523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.896705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.896898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.896898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.897030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.897128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.897187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.897329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.897462] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.897549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 699.897607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.897740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 699.897817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.897898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 699.897985] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.400252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6021d487-9de7-424f-8bb7-283b2180f7a7: rpc.has_security_group_logging(os_id): False [ 700.417194] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.417370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.417414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.417676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.417802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.417915] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.418027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.418082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.418226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.418301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.418470] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.418563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.418621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.418755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.418829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.419020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.419121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.419180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.419317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.419391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.419474] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be created. [ 700.473489] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.473638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.473707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.473923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.474120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.483297] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 700.531463] env[62815]: INFO networking_nsxv3.common.synchronization [req-c18ce30c-3365-40cf-ae29-f9abc6f0e5cc req-7cb6d53a-0678-42c8-a63a-643fc8fc9aba tempest-ServerGroupTestJSON-304102592 tempest-ServerGroupTestJSON-304102592-project-member] Enqueued Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_members [ 700.532054] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_members [ 700.532388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.532503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.532586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.532848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.533180] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.533286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.533365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.533534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.533631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.533729] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.758608] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 700.758841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.944367] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.944571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-614" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.944695] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-614" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.945062] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-614" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.945448] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.945618] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.945745] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.945968] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.946546] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.946546] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.946546] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.946546] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.946751] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.946793] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.946877] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.947016] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.974754] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.974813] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.974941] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.975157] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-614" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 700.975590] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-fd1f4800-d342-4563-82aa-70a79aca0dd5 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.976470] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 700.976606] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.976924] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 700.977079] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1f4800-d342-4563-82aa-70a79aca0dd5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.036233] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.036397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.036458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.036650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.036741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.036931] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.037040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.037098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.037242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.037316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.037398] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b65322-480c-4891-a478-1d5f60cffcc2 already deleted. [ 701.037474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.480115] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.480429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.480429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.480716] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.480896] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.481251] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port fd1f4800-d342-4563-82aa-70a79aca0dd5 not found, creating... [ 701.481361] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.481492] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.481588] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.481808] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.481956] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.482258] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.482418] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.482525] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.482728] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.482864] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.482999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: fd1f4800-d342-4563-82aa-70a79aca0dd5 is going to be created. [ 701.503729] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.504047] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 701.504295] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.504657] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 701.504933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 701.505190] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.363698] env[62815]: INFO networking_nsxv3.common.synchronization [req-0f915988-072f-486a-a4f3-b6d0da5be1ff req-73b91422-91f7-42e4-92c3-6c94b4fe92d1 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_members [ 702.364780] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_members [ 702.365242] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.365380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.365467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.366548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.367370] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.367370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.367370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.367370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.367935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.367935] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.432802] env[62815]: INFO networking_nsxv3.common.synchronization [req-c18ce30c-3365-40cf-ae29-f9abc6f0e5cc req-56ccde80-5e87-4177-958c-25314feb7973 service nova] Enqueued Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_rules [ 702.432802] env[62815]: INFO networking_nsxv3.common.synchronization [req-c18ce30c-3365-40cf-ae29-f9abc6f0e5cc req-56ccde80-5e87-4177-958c-25314feb7973 service nova] Enqueued Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_members [ 702.432802] env[62815]: INFO networking_nsxv3.common.synchronization [req-c18ce30c-3365-40cf-ae29-f9abc6f0e5cc req-56ccde80-5e87-4177-958c-25314feb7973 service nova] Enqueued Resource ID: fd1f4800-d342-4563-82aa-70a79aca0dd5 with Priority: HIGHEST for action port [ 702.432802] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_rules [ 702.432802] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_members [ 702.432802] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1f4800-d342-4563-82aa-70a79aca0dd5 with Priority: HIGHEST for action port [ 702.434243] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.434503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.434645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.437794] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.437794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.437794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.437794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.437794] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.438822] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1f4800-d342-4563-82aa-70a79aca0dd5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.439061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.439217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.439450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.439716] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1f4800-d342-4563-82aa-70a79aca0dd5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.531351] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 702.531351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.752222] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.752463] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.752640] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.753302] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.753985] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.754236] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.754386] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.754714] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.755294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.755606] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.755734] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.755863] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.756024] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.756165] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.756336] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.756492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.775932] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.776145] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.776276] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.776491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.777613] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-543bbca8-ef16-49be-a244-7753da85b2cd taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.777613] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.777613] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.777613] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.777613] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('543bbca8-ef16-49be-a244-7753da85b2cd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.870091] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.870265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.870322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.870491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.870797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.870797] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.870946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.870946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.871189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.871189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.871301] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d already deleted. [ 702.871301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.942861] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd1f4800-d342-4563-82aa-70a79aca0dd5 with status ACTIVE [ 702.943123] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.943322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.943413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.943679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.944409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.944409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.944409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.944409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.944702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.944702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.944866] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.944971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.945044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.945253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.945359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.945453] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd1f4800-d342-4563-82aa-70a79aca0dd5 is going to be updated. [ 702.947770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.947944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.948139] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.967658] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.967658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 702.967658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.967658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 702.967658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 702.967658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1f4800-d342-4563-82aa-70a79aca0dd5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.171058] env[62815]: INFO networking_nsxv3.common.synchronization [req-69d7d03e-23fa-4487-a7c4-bea8cbb66183 req-e1242421-4fc6-4aff-91b0-d2478919601a tempest-ServerActionsV293TestJSON-1409986256 tempest-ServerActionsV293TestJSON-1409986256-project-member] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_members [ 703.171591] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGHEST for action security_group_members [ 703.171904] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.172023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.172092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.172305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.172471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.172571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.172629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.172776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.172860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.172957] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.280117] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.280359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.280491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.280809] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.281112] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.284252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 543bbca8-ef16-49be-a244-7753da85b2cd not found, creating... [ 703.284620] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.284814] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.284943] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.285232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.285393] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.285687] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.289093] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.289271] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.289541] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.289720] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.289933] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 543bbca8-ef16-49be-a244-7753da85b2cd is going to be created. [ 703.311020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.311020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.311020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.311375] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.311375] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.311597] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.450132] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.675354] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.675747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.675747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.675895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.675895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.676066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.676183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.676246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.676369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.676447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.676525] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 is going to be updated. [ 703.711367] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.711550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.711592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.711776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.711917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.719732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13765b88-768f-4b1f-9fb5-8542df45be52 in Status: IN_PROGRESS for 2s [ 703.953811] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.954188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.954353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.954650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.954850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.955041] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b65322-480c-4891-a478-1d5f60cffcc2 is going to be created. [ 703.982147] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.982147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 703.982147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.982147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 703.982147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 703.996025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b65322-480c-4891-a478-1d5f60cffcc2 in Status: UNINITIALIZED for 2s [ 704.352603] env[62815]: INFO networking_nsxv3.common.synchronization [req-0f915988-072f-486a-a4f3-b6d0da5be1ff req-f9e2baa2-d3bd-48fb-97ab-2dd197d120f0 service nova] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_rules [ 704.353082] env[62815]: INFO networking_nsxv3.common.synchronization [req-0f915988-072f-486a-a4f3-b6d0da5be1ff req-f9e2baa2-d3bd-48fb-97ab-2dd197d120f0 service nova] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_members [ 704.353082] env[62815]: INFO networking_nsxv3.common.synchronization [req-0f915988-072f-486a-a4f3-b6d0da5be1ff req-f9e2baa2-d3bd-48fb-97ab-2dd197d120f0 service nova] Enqueued Resource ID: 543bbca8-ef16-49be-a244-7753da85b2cd with Priority: HIGHEST for action port [ 704.354721] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_rules [ 704.354721] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_members [ 704.354721] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543bbca8-ef16-49be-a244-7753da85b2cd with Priority: HIGHEST for action port [ 704.354721] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.354721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.354721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.355187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.355187] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.359483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.359607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.359679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.359908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.360474] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.360474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.360474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.360474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.360474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.360750] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.363476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-543bbca8-ef16-49be-a244-7753da85b2cd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.363476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.363476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.363611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.363686] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('543bbca8-ef16-49be-a244-7753da85b2cd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.859826] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.860190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.870092] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.870092] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 543bbca8-ef16-49be-a244-7753da85b2cd with status ACTIVE [ 704.870270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.870395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.870461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.871887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.871887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.872067] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.872180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.872180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.872395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.872438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.872580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.872676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.872755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.872904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.872981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.873921] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 543bbca8-ef16-49be-a244-7753da85b2cd is going to be updated. [ 704.893500] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.893627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 704.893690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.893894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 704.894029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 704.894234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-543bbca8-ef16-49be-a244-7753da85b2cd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.185859] env[62815]: INFO networking_nsxv3.common.synchronization [req-a82f1793-7c09-46f4-ae0c-348a0721b2d7 req-f7f003a5-ec3f-4923-86b4-2d11d952b503 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 705.186406] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 705.186711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.186832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.187529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.188618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.188618] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.188618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.188618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.190493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.190661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.190835] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.376280] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.697437] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.697616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.697676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.697881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.697977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.698182] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.698273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.698333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.698491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.698572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.698656] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 already deleted. [ 705.698735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.738467] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13765b88-768f-4b1f-9fb5-8542df45be52 in Status: SUCCESS [ 705.738669] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 deletion is rescheduled due to dependency. [ 705.738789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.878320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.878652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.878652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.879098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.879098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.879098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d is going to be created. [ 705.902744] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.902877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 705.902877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.903679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 705.903679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 705.913711] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2c257cd-88aa-41f2-80e5-a79e264a317d in Status: UNINITIALIZED for 2s [ 706.007730] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b65322-480c-4891-a478-1d5f60cffcc2 in Status: SUCCESS [ 706.007927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.008134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.008362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.008554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.008745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.008977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.009174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.009260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.009795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.010795] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.104821] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-195 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.105057] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.105192] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.105523] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.105758] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.105915] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.106048] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.106266] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.106429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.106736] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.106736] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.106833] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.106920] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.107042] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.107148] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.107282] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.126463] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.126690] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.129508] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.129815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.130180] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.130364] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.131112] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.131112] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.131112] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d0d7f2c-72ca-4e6c-a72b-cb448cffda88',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.521807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.521807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.521807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.521807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.521807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.522626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.522626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.522626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.522626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.522626] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.634317] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.634568] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.634694] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.635102] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.635333] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.635522] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 not found, creating... [ 706.635806] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.635971] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.636103] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.636334] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.636478] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.636810] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.637121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.637121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.637342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.637478] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.637621] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 is going to be created. [ 706.655875] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.656152] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 706.656283] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.656545] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 706.656788] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 706.657044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.028827] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64b65322-480c-4891-a478-1d5f60cffcc2: rpc.has_security_group_logging(os_id): False [ 707.053610] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.053815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.053815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.054047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.054145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.054352] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.054459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.054509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.054647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.054720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.054889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.054983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.055066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.055183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.055257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.055437] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.055554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.055605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.055715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.055838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.055899] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64b65322-480c-4891-a478-1d5f60cffcc2 is going to be created. [ 707.128335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.128512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.128596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.128789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.129269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.144866] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64b65322-480c-4891-a478-1d5f60cffcc2 in Status: IN_PROGRESS for 2s [ 707.729014] env[62815]: INFO networking_nsxv3.common.synchronization [req-a82f1793-7c09-46f4-ae0c-348a0721b2d7 req-07a65eb2-4e4e-4d55-86b2-aa5d6dc42c9d service nova] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 707.729227] env[62815]: INFO networking_nsxv3.common.synchronization [req-a82f1793-7c09-46f4-ae0c-348a0721b2d7 req-07a65eb2-4e4e-4d55-86b2-aa5d6dc42c9d service nova] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 707.729371] env[62815]: INFO networking_nsxv3.common.synchronization [req-a82f1793-7c09-46f4-ae0c-348a0721b2d7 req-07a65eb2-4e4e-4d55-86b2-aa5d6dc42c9d service nova] Enqueued Resource ID: 9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 with Priority: HIGHEST for action port [ 707.730406] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 707.730594] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 707.730700] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 with Priority: HIGHEST for action port [ 707.731758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.731903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.731970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.732249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.732351] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.739354] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.739354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.739354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.739354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.739697] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.739783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.739872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.740148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.740258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.740425] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.741722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.741834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.741902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.742122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.742220] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d0d7f2c-72ca-4e6c-a72b-cb448cffda88',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.922636] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2c257cd-88aa-41f2-80e5-a79e264a317d in Status: SUCCESS [ 707.922806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.923066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.923234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.923388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.923506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 707.923572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.923720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 707.923830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.923878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 707.924083] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.244538] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.244861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.244906] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.245853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 with status ACTIVE [ 708.246090] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.246244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.246331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.246562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.247196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.247196] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.247196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.247196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.247196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.247196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.247513] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.247513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.247594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.247775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.247775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.247873] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d0d7f2c-72ca-4e6c-a72b-cb448cffda88 is going to be updated. [ 708.267400] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.267589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.267668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.267922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.268110] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.268295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d0d7f2c-72ca-4e6c-a72b-cb448cffda88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.426535] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.750186] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.929141] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2c257cd-88aa-41f2-80e5-a79e264a317d: rpc.has_security_group_logging(os_id): False [ 708.946599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.946599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.946599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.946599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.946599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.946599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.946823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.946823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.946880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.947336] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.947336] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d is going to be created. [ 708.999584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.999584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.999584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.999877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.000075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.009890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2c257cd-88aa-41f2-80e5-a79e264a317d in Status: IN_PROGRESS for 2s [ 709.159821] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64b65322-480c-4891-a478-1d5f60cffcc2 in Status: SUCCESS [ 709.159935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.254086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.254470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.254470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.254470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.254673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.254673] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be created. [ 709.275493] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.275493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.275700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.275735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.275881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.279059] env[62815]: INFO networking_nsxv3.common.synchronization [req-d3c84575-c5f7-4b78-8344-09f0cd7e4706 req-d6f4997b-0ce1-4c44-8eaf-b0b8cd05ab40 tempest-MigrationsAdminTest-121633230 tempest-MigrationsAdminTest-121633230-project-member] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 709.279553] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 709.279889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.280010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.280082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.280258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.280405] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.280495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.280554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.280687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.280961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.280961] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.290251] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: UNINITIALIZED for 2s [ 709.787042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.804755] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.805243] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.805850] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.806184] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.806663] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.806663] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.806831] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.806967] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.807131] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.807342] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.807478] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.807588] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.807695] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.807803] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.807946] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.808053] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.827488] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.827676] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.827840] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.828203] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 709.828350] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-082783b3-ba82-47ef-982c-ebde56f9ad8c taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.828532] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 709.828855] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.828995] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 709.829152] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('082783b3-ba82-47ef-982c-ebde56f9ad8c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.290374] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.333987] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.334241] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.334381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.334648] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.334804] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.334962] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 082783b3-ba82-47ef-982c-ebde56f9ad8c not found, creating... [ 710.335239] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.335399] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.335516] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.335740] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.335882] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.336171] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.336327] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.336445] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.336652] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.336788] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.336927] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 082783b3-ba82-47ef-982c-ebde56f9ad8c is going to be created. [ 710.356134] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.356294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.356412] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.356624] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.356850] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.357148] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.793553] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.795442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.795442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.795442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.795442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.795442] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be updated. [ 710.820916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.821084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 710.821159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.821373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 710.821516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 710.830181] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 711.027030] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2c257cd-88aa-41f2-80e5-a79e264a317d in Status: SUCCESS [ 711.027030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.195376] env[62815]: INFO networking_nsxv3.common.synchronization [req-d3c84575-c5f7-4b78-8344-09f0cd7e4706 req-ef4871b7-52ab-43e5-916b-185fe9bb27f1 service nova] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_rules [ 711.195376] env[62815]: INFO networking_nsxv3.common.synchronization [req-d3c84575-c5f7-4b78-8344-09f0cd7e4706 req-ef4871b7-52ab-43e5-916b-185fe9bb27f1 service nova] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 711.195376] env[62815]: INFO networking_nsxv3.common.synchronization [req-d3c84575-c5f7-4b78-8344-09f0cd7e4706 req-ef4871b7-52ab-43e5-916b-185fe9bb27f1 service nova] Enqueued Resource ID: 082783b3-ba82-47ef-982c-ebde56f9ad8c with Priority: HIGHEST for action port [ 711.195376] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_rules [ 711.195376] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 711.195376] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082783b3-ba82-47ef-982c-ebde56f9ad8c with Priority: HIGHEST for action port [ 711.195376] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.195376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.195376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.195376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.196257] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.198022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.198022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.198022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-082783b3-ba82-47ef-982c-ebde56f9ad8c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.198022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.198022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.198022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.198022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('082783b3-ba82-47ef-982c-ebde56f9ad8c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.300655] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 711.300960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.301078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.301291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.301480] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.301596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.301662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.301806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.301891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.301976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.302116] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.700876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.701103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.701239] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 082783b3-ba82-47ef-982c-ebde56f9ad8c with status ACTIVE [ 711.701464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.702077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.702330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.702961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.702961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.702961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.702961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.702961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.703229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.703343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.703545] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.703618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.703655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.703774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.703919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.705371] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 082783b3-ba82-47ef-982c-ebde56f9ad8c is going to be updated. [ 711.729980] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.730134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 711.730299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.730409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 711.730557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.730691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-082783b3-ba82-47ef-982c-ebde56f9ad8c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 711.804685] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.307287] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd01ddbc-d1e1-4701-8791-8347e2ae4ba7: rpc.has_security_group_logging(os_id): False [ 712.394317] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.394317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.394317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.394317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.394317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.394317] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.394317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.394317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.394727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.394727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.394727] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be created. [ 712.467637] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.469020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.469020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.469020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.469020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.478190] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 712.840350] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 712.840678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.840900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.841108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.841339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.841492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 712.841560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.841784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 712.841894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 712.842038] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.345476] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.849385] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.892883] env[62815]: INFO networking_nsxv3.common.synchronization [req-9d089810-878e-4df5-97ae-2aed21ade99d req-99367e3d-75ec-4e9d-8c0c-2b43c47c4395 tempest-ServerGroupTestJSON-304102592 tempest-ServerGroupTestJSON-304102592-project-member] Enqueued Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_members [ 713.895353] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b65322-480c-4891-a478-1d5f60cffcc2 with Priority: HIGHEST for action security_group_members [ 713.895896] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b65322-480c-4891-a478-1d5f60cffcc2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.896069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.896203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.896440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.896622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.896762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 713.896844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.897030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 713.897157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.897271] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64b65322-480c-4891-a478-1d5f60cffcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.353290] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.353623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.353623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.353700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.353729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.353825] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be updated. [ 714.395257] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.396160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.396160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.396160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.396160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.399884] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.400044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.400044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.400664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.400664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.400664] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.400664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.400900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.400900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.400970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.401174] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b65322-480c-4891-a478-1d5f60cffcc2 is going to be updated. [ 714.404519] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 714.426028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.426028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 714.426028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.426028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 714.426028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 714.432305] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b65322-480c-4891-a478-1d5f60cffcc2 in Status: IN_PROGRESS for 2s [ 714.492140] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 714.492387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.414013] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 716.414321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.414391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.414596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.414786] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.414905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.414970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.415133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.415216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.415301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.415390] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.440828] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b65322-480c-4891-a478-1d5f60cffcc2 in Status: SUCCESS [ 716.441033] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b65322-480c-4891-a478-1d5f60cffcc2 deletion is rescheduled due to dependency. [ 716.441151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b65322-480c-4891-a478-1d5f60cffcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.917763] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.917968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.918086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.918345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.918541] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.918623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.918676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.918823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.918907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.918991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.919145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.919235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.919415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.919483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.919589] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.919673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 716.919730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.919926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 716.920015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.920094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 716.920178] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.421909] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b036f05a-9535-4198-b6ab-eff3bdc28054: rpc.has_security_group_logging(os_id): False [ 717.438617] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.438808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.438855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.439046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.439141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.439348] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.439455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.439519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.439640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.439714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.440052] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.440196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.440279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.440478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.440577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.440809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.440918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.440994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.441187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.441294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.441392] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be updated. [ 717.501503] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.501503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 717.501503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.501810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 717.501810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 717.513449] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 718.896383] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 718.896645] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 719.535784] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 719.536015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.020527] env[62815]: INFO networking_nsxv3.common.synchronization [req-da2eb8c6-5f60-451d-b945-70c4b37d6c7c req-3046c52b-d251-4fb8-a913-37de526d5ace tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 721.021157] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 721.021474] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.021594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.021661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.021877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.022040] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.022137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.022341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.022523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.022611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.022705] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.525227] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.525405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.525521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.525682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.525790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.525972] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.526087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.526150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.526294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.526383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.526449] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 721.557827] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.557970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.558048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.558268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.558426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 721.571745] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 723.585371] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 723.585654] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 723.585654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.694729] env[62815]: INFO networking_nsxv3.common.synchronization [req-3c0138d1-ad25-44bc-9d12-2bd3185a5125 req-a20443fc-b8c0-4369-ae94-83a610a40a74 tempest-FloatingIPsAssociationTestJSON-821854022 tempest-FloatingIPsAssociationTestJSON-821854022-project-member] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 723.695317] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 723.695660] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.695784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.695848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.696067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.696745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.696745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.696745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.696745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.696745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.696745] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.058397] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.058634] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.058749] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.059031] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.059290] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.059471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.059741] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.059806] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.059948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.060188] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.060307] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.060412] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.060522] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.060635] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.060732] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.060872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.079462] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.079643] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.079806] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.080127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.080496] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-96388fe5-8868-4b94-bb04-f734cb4f8017 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.080642] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.080765] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.081133] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.081281] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96388fe5-8868-4b94-bb04-f734cb4f8017',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.198893] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.584062] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.584062] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.584238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.584457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.584608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.584763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 96388fe5-8868-4b94-bb04-f734cb4f8017 not found, creating... [ 724.585036] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.585244] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.585462] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.585694] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.585931] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.586115] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.586288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.586412] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.586619] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.586753] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.586911] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 96388fe5-8868-4b94-bb04-f734cb4f8017 is going to be created. [ 724.607406] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.607610] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.607745] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.608016] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.608253] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.608780] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.701541] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.206100] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.206100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.206100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.206100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.206100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.206100] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be updated. [ 725.233958] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.233958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.233958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.233958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.233958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.241087] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: IN_PROGRESS for 2s [ 725.466170] env[62815]: INFO networking_nsxv3.common.synchronization [req-3c0138d1-ad25-44bc-9d12-2bd3185a5125 req-2cf461ba-4607-4591-8d35-06eec109619b service nova] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_rules [ 725.466170] env[62815]: INFO networking_nsxv3.common.synchronization [req-3c0138d1-ad25-44bc-9d12-2bd3185a5125 req-2cf461ba-4607-4591-8d35-06eec109619b service nova] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 725.466170] env[62815]: INFO networking_nsxv3.common.synchronization [req-3c0138d1-ad25-44bc-9d12-2bd3185a5125 req-2cf461ba-4607-4591-8d35-06eec109619b service nova] Enqueued Resource ID: 96388fe5-8868-4b94-bb04-f734cb4f8017 with Priority: HIGHEST for action port [ 725.466170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_rules [ 725.466170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 725.466170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96388fe5-8868-4b94-bb04-f734cb4f8017 with Priority: HIGHEST for action port [ 725.466170] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.466170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.466170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.466170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.466170] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.467635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.467635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.467635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-96388fe5-8868-4b94-bb04-f734cb4f8017 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.467635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.467635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.467995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.467995] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96388fe5-8868-4b94-bb04-f734cb4f8017',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.490458] env[62815]: INFO networking_nsxv3.common.synchronization [req-c176abc3-9f69-472b-9a0e-7dc7214c2b3b req-ca07ad3a-7018-4726-ac76-92b867d3ee6c tempest-ListImageFiltersTestJSON-1830437384 tempest-ListImageFiltersTestJSON-1830437384-project-member] Enqueued Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 725.491110] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 with Priority: HIGHEST for action security_group_members [ 725.491403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7db29840-7ccf-49ac-af49-fd6b13cfbba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.492334] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.492334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.492613] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7db29840-7ccf-49ac-af49-fd6b13cfbba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.969236] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.969591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.969591] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96388fe5-8868-4b94-bb04-f734cb4f8017 with status ACTIVE [ 725.969743] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.969856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.969956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.970181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.970298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.970446] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.970541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.970599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.970750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.970828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.971044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.971273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.971273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.971371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.971439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.971484] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96388fe5-8868-4b94-bb04-f734cb4f8017 is going to be updated. [ 725.991518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.991518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.991518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.991698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.991727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96388fe5-8868-4b94-bb04-f734cb4f8017" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.994113] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.994220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.994283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.994438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.994517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.994690] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.994789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 725.994848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.995683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 725.995683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 725.995683] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 is going to be updated. [ 726.018478] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.018478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.018478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.018690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.018727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.026249] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: IN_PROGRESS for 2s [ 726.274320] env[62815]: INFO networking_nsxv3.common.synchronization [req-c4f1028a-5e5a-4c9e-8b99-4ed80f7dcc44 req-744f8b9b-84e0-4917-afe6-b10c565c665b tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_members [ 726.274725] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_members [ 726.275104] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.275254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.275325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.275575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.275742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.276115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.276115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.276115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.276115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.276308] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.645417] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.645625] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.645762] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.646072] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.646331] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.646490] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.646608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.646821] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.646962] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.647974] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.648121] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.648242] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.648355] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.648467] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.648574] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.648708] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.666735] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.666945] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.667057] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.667225] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.667605] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.667845] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.668019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.668354] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.668515] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f0fe9a7-20a1-4b79-a90f-17179c3a94de',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.779176] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.779310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.779385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.779607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.779698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.779907] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.780037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 726.780146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.780294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 726.780370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 726.780455] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c already deleted. [ 726.780548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.171062] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.171450] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.171450] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.171696] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.171844] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.171999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 9f0fe9a7-20a1-4b79-a90f-17179c3a94de not found, creating... [ 727.172287] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.172448] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.172602] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.172818] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.172956] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.173249] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.173403] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.173517] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.173717] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.173847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.173983] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 9f0fe9a7-20a1-4b79-a90f-17179c3a94de is going to be created. [ 727.193467] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.193649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.193710] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.193948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.194180] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.194385] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.251587] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 727.251726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.251924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.252150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.252425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.252425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 727.252547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.252626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 727.252711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 727.252804] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.755370] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.035791] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 in Status: SUCCESS [ 728.035994] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7db29840-7ccf-49ac-af49-fd6b13cfbba7 deletion is rescheduled due to dependency. [ 728.036095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7db29840-7ccf-49ac-af49-fd6b13cfbba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.258667] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.332870] env[62815]: INFO networking_nsxv3.common.synchronization [req-c4f1028a-5e5a-4c9e-8b99-4ed80f7dcc44 req-a1a96463-36ec-42d3-a14f-62d7e7feb464 service nova] Enqueued Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_rules [ 728.333104] env[62815]: INFO networking_nsxv3.common.synchronization [req-c4f1028a-5e5a-4c9e-8b99-4ed80f7dcc44 req-a1a96463-36ec-42d3-a14f-62d7e7feb464 service nova] Enqueued Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_members [ 728.333291] env[62815]: INFO networking_nsxv3.common.synchronization [req-c4f1028a-5e5a-4c9e-8b99-4ed80f7dcc44 req-a1a96463-36ec-42d3-a14f-62d7e7feb464 service nova] Enqueued Resource ID: 9f0fe9a7-20a1-4b79-a90f-17179c3a94de with Priority: HIGHEST for action port [ 728.333974] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_rules [ 728.334363] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_members [ 728.334500] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f0fe9a7-20a1-4b79-a90f-17179c3a94de with Priority: HIGHEST for action port [ 728.334816] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.334956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.335058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.335294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.335379] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.339571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.339571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.339571] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.339571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.339571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.339571] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f0fe9a7-20a1-4b79-a90f-17179c3a94de',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.764742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.764909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.765045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.765175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.765272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.765359] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be updated. [ 728.794527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.794527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.794527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.794527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.794527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.802797] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: IN_PROGRESS for 2s [ 728.842922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.842922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.846015] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.847107] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f0fe9a7-20a1-4b79-a90f-17179c3a94de with status ACTIVE [ 728.847292] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.847405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.847651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.847866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.847964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.848168] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.848286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.848403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.848558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.848645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.848823] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.848967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.848967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.849313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.849430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.849557] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f0fe9a7-20a1-4b79-a90f-17179c3a94de is going to be updated. [ 728.868241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.868375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 728.868449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.868651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 728.868817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.868930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f0fe9a7-20a1-4b79-a90f-17179c3a94de" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.351303] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.564952] env[62815]: INFO networking_nsxv3.common.synchronization [req-673f439e-4454-4a57-a994-2ccd6ad667bb req-1df567e6-4769-41d2-970b-73b0d2cadfb3 tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 729.565512] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 729.565815] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.565938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.566014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.566413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.566622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.566784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.566884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.567097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.567250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.567383] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.855688] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.855848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.855905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.856141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.856240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.856338] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c is going to be created. [ 729.878708] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.878877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 729.878926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.879133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 729.879282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 729.887742] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c580d0c-d242-4267-94c1-b84435b0f93c in Status: UNINITIALIZED for 2s [ 730.070814] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.399024] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.399024] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.399024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.399024] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.399024] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.399793] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.402096] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.402096] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.402096] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.402096] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.419872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.419872] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 730.419872] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.419872] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.419872] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-a38a91f9-f134-41da-8aab-37f7ca027c51 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.419872] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.419872] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.419872] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.419872] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a38a91f9-f134-41da-8aab-37f7ca027c51',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.573570] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.812841] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 730.813179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.813886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.814307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.814571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.816016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.816016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.816016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.816016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.816016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.816016] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.925842] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.925842] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.925842] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.926060] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.926060] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.926284] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port a38a91f9-f134-41da-8aab-37f7ca027c51 not found, creating... [ 730.926552] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.926626] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.926716] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.926931] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.927086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.927360] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.927509] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.928888] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.929392] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.929566] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.929758] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: a38a91f9-f134-41da-8aab-37f7ca027c51 is going to be created. [ 730.948549] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.948762] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 730.948883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.949454] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 730.950322] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 730.950619] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.078613] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.078837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.078837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.079041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.079159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.079260] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 731.113192] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.113390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.113456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.113623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.113774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.122419] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 731.318340] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.318500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.318597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.318794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.318963] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.319308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.319308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.319308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.319465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.319465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.319579] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.319670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.319731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.319869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.320716] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.320892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.320973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.321201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.321402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.321402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.321518] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.824355] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3fac0c6-3de2-4540-bd01-063e50507e5a: rpc.has_security_group_logging(os_id): False [ 731.841880] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.842524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.842524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.845228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.845517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.845815] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.845899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.845965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.846202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.846288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.846481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.846682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.846682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.846810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.846878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.847072] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.847170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.847236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.847565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.847565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.847565] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be updated. [ 731.878507] env[62815]: INFO networking_nsxv3.common.synchronization [req-673f439e-4454-4a57-a994-2ccd6ad667bb req-b7493547-d645-4094-a573-3c5566d73321 service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 731.878709] env[62815]: INFO networking_nsxv3.common.synchronization [req-673f439e-4454-4a57-a994-2ccd6ad667bb req-b7493547-d645-4094-a573-3c5566d73321 service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 731.878853] env[62815]: INFO networking_nsxv3.common.synchronization [req-673f439e-4454-4a57-a994-2ccd6ad667bb req-b7493547-d645-4094-a573-3c5566d73321 service nova] Enqueued Resource ID: a38a91f9-f134-41da-8aab-37f7ca027c51 with Priority: HIGHEST for action port [ 731.879129] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 731.879269] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 731.879378] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38a91f9-f134-41da-8aab-37f7ca027c51 with Priority: HIGHEST for action port [ 731.880013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.881550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.881706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.881969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.882128] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.883138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.883138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.883402] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a38a91f9-f134-41da-8aab-37f7ca027c51 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.886721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.886721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.886721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.886721] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a38a91f9-f134-41da-8aab-37f7ca027c51',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.896259] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c580d0c-d242-4267-94c1-b84435b0f93c in Status: SUCCESS [ 731.896478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.896629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.896836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.897315] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.897488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.897488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.897675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.897757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.897948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.898086] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.906438] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.906516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 731.906772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.906967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 731.907169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 731.928406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: IN_PROGRESS for 2s [ 732.021349] env[62815]: INFO networking_nsxv3.common.synchronization [req-6c2e0da8-6aac-451e-a855-535a17ddbc99 req-e1c564c5-2d6f-42a6-a84a-71a696d27382 tempest-ServersNegativeTestJSON-321560529 tempest-ServersNegativeTestJSON-321560529-project-member] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 732.021939] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 732.022294] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.022421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.022488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.022744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.022892] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.022990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.023249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.023460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.023553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.023692] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.385886] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.386047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.386236] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a38a91f9-f134-41da-8aab-37f7ca027c51 with status ACTIVE [ 732.390023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.390023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.390023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.390023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.390023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a38a91f9-f134-41da-8aab-37f7ca027c51 is going to be updated. [ 732.401438] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.408794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.408794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.408794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.408944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.409122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.409277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a38a91f9-f134-41da-8aab-37f7ca027c51" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.525983] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.526169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.526250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.526469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.526567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.526767] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.526865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.526947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.527297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.527430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.527522] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 already deleted. [ 732.527604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.904697] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c580d0c-d242-4267-94c1-b84435b0f93c: rpc.has_security_group_logging(os_id): False [ 732.921219] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.922294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.922382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.922912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.922912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.922996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.923235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.923235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.923324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.923354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.924346] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c is going to be created. [ 732.983841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.983841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 732.983841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.983841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 732.983841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 732.992763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c580d0c-d242-4267-94c1-b84435b0f93c in Status: IN_PROGRESS for 2s [ 733.133496] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.135672] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.135672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.135672] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.174024] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.174024] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.174024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.174938] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.175218] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.175447] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.175668] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.175908] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.176142] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.176397] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.198753] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.198753] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.198753] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.198753] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.198753] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-f96104f3-1d92-43cf-a297-c712c968910d taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.198753] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.198753] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.198753] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.198753] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96104f3-1d92-43cf-a297-c712c968910d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.638416] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.700561] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.700802] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.700933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.701232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.701387] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.701572] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port f96104f3-1d92-43cf-a297-c712c968910d not found, creating... [ 733.701793] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.701953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.702084] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.702472] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.702472] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.702731] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.702885] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.703011] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.705372] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.705372] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.705372] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: f96104f3-1d92-43cf-a297-c712c968910d is going to be created. [ 733.706730] env[62815]: INFO networking_nsxv3.common.synchronization [None req-81eeff6d-1d55-4b56-ba04-1fa9ec1e0345 None None] Enqueued Resource ID: d350b80a-ad32-4e67-92da-2592fc6f58ef with Priority: HIGHEST for action port [ 733.710898] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d350b80a-ad32-4e67-92da-2592fc6f58ef with Priority: HIGHEST for action port [ 733.711162] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d350b80a-ad32-4e67-92da-2592fc6f58ef taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.711234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d350b80a-ad32-4e67-92da-2592fc6f58ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.711268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d350b80a-ad32-4e67-92da-2592fc6f58ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.711866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d350b80a-ad32-4e67-92da-2592fc6f58ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.711866] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d350b80a-ad32-4e67-92da-2592fc6f58ef',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.731248] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.731248] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 733.731248] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.731248] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 733.731248] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.731248] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 733.942156] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 733.942454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.147412] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.214384] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d350b80a-ad32-4e67-92da-2592fc6f58ef [ 734.214631] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.214742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.214821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.215009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.215319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.215319] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d350b80a-ad32-4e67-92da-2592fc6f58ef already deleted. [ 734.215319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d350b80a-ad32-4e67-92da-2592fc6f58ef" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.439941] env[62815]: INFO networking_nsxv3.common.synchronization [req-a493508e-5548-4819-ac78-134f6efda8ce req-1a850f6d-5836-4301-a36c-8479980b3baf tempest-ListServerFiltersTestJSON-1707760047 tempest-ListServerFiltersTestJSON-1707760047-project-member] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 734.439941] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 734.439941] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.439941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.439941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.440771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.440771] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.440771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.440771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.441125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.441125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.441361] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.653332] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.653332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.653332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.653332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.653332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.653332] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 734.681601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.681601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.681601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.681601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.681938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.697748] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 734.945671] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.945973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.946081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.947018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.947018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.947018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.947018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.947018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.947018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.947018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.947018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f already deleted. [ 734.947310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.980389] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.980389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.980389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.980656] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.982563] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.982563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 734.982563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.982563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 734.982563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 734.982563] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.982563] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.982563] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.982563] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.983947] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.983947] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.983947] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.003751] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.003922] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.004175] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.004374] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.004680] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-9596aae8-dbd7-4693-8a92-28d7e203bd38 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.004853] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.005042] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.005290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.005449] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9596aae8-dbd7-4693-8a92-28d7e203bd38',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.007324] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c580d0c-d242-4267-94c1-b84435b0f93c in Status: SUCCESS [ 735.007720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.066595] env[62815]: INFO networking_nsxv3.common.synchronization [req-6c2e0da8-6aac-451e-a855-535a17ddbc99 req-e07cf295-7841-46a9-85b0-33402e948cff service nova] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_rules [ 735.066794] env[62815]: INFO networking_nsxv3.common.synchronization [req-6c2e0da8-6aac-451e-a855-535a17ddbc99 req-e07cf295-7841-46a9-85b0-33402e948cff service nova] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 735.067127] env[62815]: INFO networking_nsxv3.common.synchronization [req-6c2e0da8-6aac-451e-a855-535a17ddbc99 req-e07cf295-7841-46a9-85b0-33402e948cff service nova] Enqueued Resource ID: f96104f3-1d92-43cf-a297-c712c968910d with Priority: HIGHEST for action port [ 735.067687] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_rules [ 735.067753] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 735.067915] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f96104f3-1d92-43cf-a297-c712c968910d with Priority: HIGHEST for action port [ 735.068253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.068409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.068508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.068782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.068928] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.069706] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.069842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.069934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.070174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.070361] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.070468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.070531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.070905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.070905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.070905] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.071655] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f96104f3-1d92-43cf-a297-c712c968910d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.072098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.072171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.072356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.072459] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96104f3-1d92-43cf-a297-c712c968910d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.507918] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.508222] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.508355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.508640] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.508791] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.508962] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 9596aae8-dbd7-4693-8a92-28d7e203bd38 not found, creating... [ 735.509247] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.509460] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.509516] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.509727] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.509866] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.510237] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.510388] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.510510] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.510717] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.510849] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.510994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 9596aae8-dbd7-4693-8a92-28d7e203bd38 is going to be created. [ 735.534586] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.534840] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.534905] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.535315] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.535857] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.536533] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.573987] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.574458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.574458] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.575232] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f96104f3-1d92-43cf-a297-c712c968910d with status ACTIVE [ 735.575406] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.575515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.575585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.575845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.575942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.576383] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.576383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.576383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.576383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.576609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.576609] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.576703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.576757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.577010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.577010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.577186] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f96104f3-1d92-43cf-a297-c712c968910d is going to be updated. [ 735.601066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.601249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 735.601340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.601545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 735.601680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 735.601964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.006951] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9c8a2c29-3f3c-46ad-844c-514ee52dd3ed None None] Enqueued Resource ID: 1d4ce532-493b-4b0a-a158-8af08875cfc6 with Priority: HIGHEST for action port [ 736.007240] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4ce532-493b-4b0a-a158-8af08875cfc6 with Priority: HIGHEST for action port [ 736.007774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d4ce532-493b-4b0a-a158-8af08875cfc6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.007902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d4ce532-493b-4b0a-a158-8af08875cfc6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.007971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d4ce532-493b-4b0a-a158-8af08875cfc6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.008277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d4ce532-493b-4b0a-a158-8af08875cfc6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.008376] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d4ce532-493b-4b0a-a158-8af08875cfc6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.079587] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.416599] env[62815]: INFO networking_nsxv3.common.synchronization [req-a493508e-5548-4819-ac78-134f6efda8ce req-bc5d0804-3a87-481e-8a89-5d498638970b service nova] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_rules [ 736.416599] env[62815]: INFO networking_nsxv3.common.synchronization [req-a493508e-5548-4819-ac78-134f6efda8ce req-bc5d0804-3a87-481e-8a89-5d498638970b service nova] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 736.416734] env[62815]: INFO networking_nsxv3.common.synchronization [req-a493508e-5548-4819-ac78-134f6efda8ce req-bc5d0804-3a87-481e-8a89-5d498638970b service nova] Enqueued Resource ID: 9596aae8-dbd7-4693-8a92-28d7e203bd38 with Priority: HIGHEST for action port [ 736.418548] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_rules [ 736.418548] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 736.418548] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9596aae8-dbd7-4693-8a92-28d7e203bd38 with Priority: HIGHEST for action port [ 736.418548] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.418548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.418548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.421824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.421899] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.422795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.422917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.422984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.424986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.429252] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.429391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.429460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.430064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.430064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.430064] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.430809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9596aae8-dbd7-4693-8a92-28d7e203bd38 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.430926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.431013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.431218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.431348] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9596aae8-dbd7-4693-8a92-28d7e203bd38',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.512397] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d4ce532-493b-4b0a-a158-8af08875cfc6 [ 736.512615] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.512748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.512843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.513038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.513135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.513302] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d4ce532-493b-4b0a-a158-8af08875cfc6 already deleted. [ 736.513302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d4ce532-493b-4b0a-a158-8af08875cfc6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.583052] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.583052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.583052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.583052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.583052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.583052] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be created. [ 736.608663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.608910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.608910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.609154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.609327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.620051] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: UNINITIALIZED for 2s [ 736.707745] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 736.708083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.708284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.708762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.708991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.709165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.709244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.709413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.709502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.709599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.709694] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.933535] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.936901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.937481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.937714] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9596aae8-dbd7-4693-8a92-28d7e203bd38 with status ACTIVE [ 736.937942] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.938106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.938197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.938530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.938530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.938734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.938800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.938872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.939674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.939851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.940233] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.940374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.940612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.940612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.940854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.940854] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9596aae8-dbd7-4693-8a92-28d7e203bd38 is going to be updated. [ 736.963805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.963954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 736.964040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.964268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 736.964403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 736.964560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9596aae8-dbd7-4693-8a92-28d7e203bd38" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.213010] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.213291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.213329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.213541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.213729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.213848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.213948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.214168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.214353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.214406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.214798] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.214948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.215034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.215198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.217167] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.217312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.217387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.217559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.217660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.217753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.217878] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.442752] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.525824] env[62815]: INFO networking_nsxv3.common.synchronization [req-cd962d1c-1fa9-4084-9eab-2491aeee7d15 req-2ff86875-c34e-4182-879b-b0d3e6c50280 tempest-ListServerFiltersTestJSON-1707760047 tempest-ListServerFiltersTestJSON-1707760047-project-member] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 737.525824] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 737.525824] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.525956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.723254] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50851b2f-e9ba-4c66-9351-f1d66386b1c2: rpc.has_security_group_logging(os_id): False [ 737.743419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.743634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.743634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.743843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.743938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.744133] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.744248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.744449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.744449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.744565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.744841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.744912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.744912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.745074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.745155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.745434] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.745567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.745636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.746825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.746825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.747025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 737.815023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.815170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.815244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.815460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.815977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.830345] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 737.945075] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.945298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.945395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.945683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.945815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.945928] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be created. [ 737.972268] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.972268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.972268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.972268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.972268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 737.981655] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: UNINITIALIZED for 2s [ 738.231019] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.231019] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.231019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.231019] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.231019] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.231019] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.231019] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.231695] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.231899] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.232193] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.252029] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.252029] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.252029] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.252029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.252029] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-91fca7cb-608d-4b00-b202-49573124b19b taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.252029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.252029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.252626] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.252626] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91fca7cb-608d-4b00-b202-49573124b19b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.320513] env[62815]: INFO networking_nsxv3.common.synchronization [req-219bf321-8da0-40c8-9d33-5fc566636b53 req-d1590e90-85fd-45c1-bd57-856864f89e85 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 738.320620] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 738.320931] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.321061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.321146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.322803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.322981] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.323476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.323476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.323476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.323476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.323637] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.355022] env[62815]: INFO networking_nsxv3.common.synchronization [req-219bf321-8da0-40c8-9d33-5fc566636b53 req-d1590e90-85fd-45c1-bd57-856864f89e85 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 738.355200] env[62815]: INFO networking_nsxv3.common.synchronization [req-219bf321-8da0-40c8-9d33-5fc566636b53 req-d1590e90-85fd-45c1-bd57-856864f89e85 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 738.355269] env[62815]: INFO networking_nsxv3.common.synchronization [req-219bf321-8da0-40c8-9d33-5fc566636b53 req-d1590e90-85fd-45c1-bd57-856864f89e85 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with Priority: HIGHEST for action port [ 738.355749] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 738.355887] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 738.355985] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with Priority: HIGHEST for action port [ 738.356271] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.356390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.356489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.356646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.356727] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.358968] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.359109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.361227] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.361227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.361227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.361227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.361227] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a994020-bb4a-4a3e-9d6e-8646f77a6ed5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.628232] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 738.628453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.628643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.628927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.629184] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.629350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.630273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.630273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.630273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.630273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.630273] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.755588] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.755813] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.755941] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.756267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.756429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.756588] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 91fca7cb-608d-4b00-b202-49573124b19b not found, creating... [ 738.756854] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.757029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.757155] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.757375] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.757515] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.757795] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.757952] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.758676] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.758971] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.759278] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.759476] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 91fca7cb-608d-4b00-b202-49573124b19b is going to be created. [ 738.794724] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.794724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.795140] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.795757] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.796267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.796691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.824914] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.862064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.862649] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with status ACTIVE [ 738.862802] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.862957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.863041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.863348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.863459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.863625] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.863774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.863774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.863934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.864065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.864234] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.864334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.864395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.864543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.864616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.864700] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 is going to be updated. [ 738.902466] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.902927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.903153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.903477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.903740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.904262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.135895] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.135895] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.135895] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.135895] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.135895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.136535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.136535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.136535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.136535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.136535] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.332300] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.641440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 686574a8-1080-450a-a759-40ce406709a1: rpc.has_security_group_logging(os_id): False [ 739.662313] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.662484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.662555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.662740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.662832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.663051] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.663152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.663204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.663362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.663438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.663596] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.663691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.663786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.663966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.664074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.664258] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.664350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.664854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.664854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.664854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.665044] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be created. [ 739.723621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.723722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.723799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.724035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.724223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.741160] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 739.835264] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.835515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.835515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.835759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.835803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.835886] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be updated. [ 739.847290] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 739.847290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.869038] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.871832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.871832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.871832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.871832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.880409] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: IN_PROGRESS for 2s [ 739.994623] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 739.994623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.994783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.994977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.996028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.996028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.996028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.996028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.996028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.996028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.996028] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.996753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.996753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.997102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.997102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.998770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.999460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.999460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.999460] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.323321] env[62815]: INFO networking_nsxv3.common.synchronization [req-e2087dab-7813-4d38-bf41-6f1a0470b15b req-6e0ae585-26cc-494b-b5bf-db1f46600a21 tempest-ListServerFiltersTestJSON-1707760047 tempest-ListServerFiltersTestJSON-1707760047-project-member] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 740.324016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 740.324216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.324357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.339418] env[62815]: INFO networking_nsxv3.common.synchronization [req-cd962d1c-1fa9-4084-9eab-2491aeee7d15 req-39d9fe5a-199a-40cd-8123-b9222843641c service nova] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_rules [ 740.339418] env[62815]: INFO networking_nsxv3.common.synchronization [req-cd962d1c-1fa9-4084-9eab-2491aeee7d15 req-39d9fe5a-199a-40cd-8123-b9222843641c service nova] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 740.339418] env[62815]: INFO networking_nsxv3.common.synchronization [req-cd962d1c-1fa9-4084-9eab-2491aeee7d15 req-39d9fe5a-199a-40cd-8123-b9222843641c service nova] Enqueued Resource ID: 91fca7cb-608d-4b00-b202-49573124b19b with Priority: HIGHEST for action port [ 740.339418] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_rules [ 740.339418] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 740.339418] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91fca7cb-608d-4b00-b202-49573124b19b with Priority: HIGHEST for action port [ 740.344176] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.344290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.345276] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.345276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.345276] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-91fca7cb-608d-4b00-b202-49573124b19b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.345276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.345506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.345506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.345572] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91fca7cb-608d-4b00-b202-49573124b19b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.502840] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.502840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.504024] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.812417] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.812685] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.812782] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.813151] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.813340] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.813505] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.813622] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.813971] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.814144] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.814821] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.815037] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.815178] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.815351] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.815487] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.815613] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.816284] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.834640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.834827] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.834975] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.835211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-914" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.835546] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-a949ce41-1e1d-4244-8b14-47017e05c666 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.835715] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.835864] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.836364] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.836525] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a949ce41-1e1d-4244-8b14-47017e05c666',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.850555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91fca7cb-608d-4b00-b202-49573124b19b with status ACTIVE [ 740.850797] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.850965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.851079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.851404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.851512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.851674] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.851815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.851889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.852047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.852137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.852338] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.852454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.852525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.852673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.852782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.852831] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91fca7cb-608d-4b00-b202-49573124b19b is going to be updated. [ 740.878492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.878722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.878941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.879071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.879212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.879418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91fca7cb-608d-4b00-b202-49573124b19b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.010605] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.147494] env[62815]: INFO networking_nsxv3.common.synchronization [req-66472db5-6069-4563-859b-1c68068a948e req-d0d39e83-274a-4071-9b63-1a772bf266aa tempest-FloatingIPsAssociationTestJSON-821854022 tempest-FloatingIPsAssociationTestJSON-821854022-project-member] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 741.148449] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 741.148949] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.149819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.150027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.150370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.151576] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.151827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.152479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.152909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.153125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.153394] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.343397] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.343397] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port a949ce41-1e1d-4244-8b14-47017e05c666 not found, creating... [ 741.343397] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.343397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.344784] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.344784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.344784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.344784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.345106] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.347358] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: a949ce41-1e1d-4244-8b14-47017e05c666 is going to be created. [ 741.368683] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.374022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.374022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.374022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.374022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.374022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.517575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.517575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.517575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.517575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.517575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.517575] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 741.545433] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.547549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.547549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.547549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.547549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.556056] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 741.657096] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.756759] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 741.756759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.894418] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: SUCCESS [ 741.894418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.894418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.894418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.894418] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.894418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.894418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.895454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.895730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.896329] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.160312] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.399547] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.581769] env[62815]: INFO networking_nsxv3.common.synchronization [req-e2087dab-7813-4d38-bf41-6f1a0470b15b req-5b55668f-155e-4929-ba14-2ff31aa7efc7 service nova] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_rules [ 742.582049] env[62815]: INFO networking_nsxv3.common.synchronization [req-e2087dab-7813-4d38-bf41-6f1a0470b15b req-5b55668f-155e-4929-ba14-2ff31aa7efc7 service nova] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 742.582248] env[62815]: INFO networking_nsxv3.common.synchronization [req-e2087dab-7813-4d38-bf41-6f1a0470b15b req-5b55668f-155e-4929-ba14-2ff31aa7efc7 service nova] Enqueued Resource ID: a949ce41-1e1d-4244-8b14-47017e05c666 with Priority: HIGHEST for action port [ 742.582820] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_rules [ 742.582991] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 742.583444] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a949ce41-1e1d-4244-8b14-47017e05c666 with Priority: HIGHEST for action port [ 742.583824] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.583969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.584225] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.584309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.584492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a949ce41-1e1d-4244-8b14-47017e05c666 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.584604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.584661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.584864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.584960] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a949ce41-1e1d-4244-8b14-47017e05c666',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.663094] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.663358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.663440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.663969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.663969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.663969] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be updated. [ 742.689591] env[62815]: INFO networking_nsxv3.common.synchronization [None req-69bd1bb7-2b17-4535-96c4-fff2eb6b05f0 None None] Enqueued Resource ID: 381211d0-8d76-4b1b-a633-33002ba813c2 with Priority: HIGHEST for action port [ 742.690013] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 381211d0-8d76-4b1b-a633-33002ba813c2 with Priority: HIGHEST for action port [ 742.690442] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-381211d0-8d76-4b1b-a633-33002ba813c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.690576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-381211d0-8d76-4b1b-a633-33002ba813c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.690576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-381211d0-8d76-4b1b-a633-33002ba813c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.690868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-381211d0-8d76-4b1b-a633-33002ba813c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.690922] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('381211d0-8d76-4b1b-a633-33002ba813c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.699063] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.699217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.699271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.699485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.699644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.707913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: IN_PROGRESS for 2s [ 742.797255] env[62815]: INFO networking_nsxv3.common.synchronization [req-fa848ff3-87c6-4dc4-901b-54d0a96e8e43 req-5ad3bd34-1fe2-481b-88a7-d2690861429d tempest-ServersWithSpecificFlavorTestJSON-887013430 tempest-ServersWithSpecificFlavorTestJSON-887013430-project-member] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 742.797255] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 742.797255] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.797255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.797255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.798808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.800047] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.800369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.801480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.801897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.802665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.803419] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.904903] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.091024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a949ce41-1e1d-4244-8b14-47017e05c666 with status ACTIVE [ 743.091024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.091024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.091024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.091024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.091024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a949ce41-1e1d-4244-8b14-47017e05c666 is going to be updated. [ 743.114264] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.114461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.114501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.115167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.115167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.115167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a949ce41-1e1d-4244-8b14-47017e05c666" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.135464] env[62815]: INFO networking_nsxv3.common.synchronization [req-819f2537-7ca8-4b4b-8b95-abd04a4b13e6 req-8bcccf35-e9e7-41ed-b503-bff26b5c3225 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 743.135464] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 743.135464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.135464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.158875] env[62815]: INFO networking_nsxv3.common.synchronization [req-819f2537-7ca8-4b4b-8b95-abd04a4b13e6 req-8bcccf35-e9e7-41ed-b503-bff26b5c3225 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 743.158973] env[62815]: INFO networking_nsxv3.common.synchronization [req-819f2537-7ca8-4b4b-8b95-abd04a4b13e6 req-8bcccf35-e9e7-41ed-b503-bff26b5c3225 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 743.159113] env[62815]: INFO networking_nsxv3.common.synchronization [req-819f2537-7ca8-4b4b-8b95-abd04a4b13e6 req-8bcccf35-e9e7-41ed-b503-bff26b5c3225 tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with Priority: HIGHEST for action port [ 743.160124] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_rules [ 743.160124] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 743.160124] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with Priority: HIGHEST for action port [ 743.160303] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.160510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.160621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.162123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.162123] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.162123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.162123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.162123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.162123] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a994020-bb4a-4a3e-9d6e-8646f77a6ed5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.195322] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 381211d0-8d76-4b1b-a633-33002ba813c2 [ 743.196410] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.196537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.196578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.197207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.197207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.197207] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:381211d0-8d76-4b1b-a633-33002ba813c2 already deleted. [ 743.197207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-381211d0-8d76-4b1b-a633-33002ba813c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.308787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.309278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.309278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.309278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.309278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.310498] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.310644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.310717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.310902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.310987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.311533] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be updated. [ 743.361409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.362730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.362827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.363074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.363221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.376390] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 743.379903] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.379903] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.379903] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.381069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.381383] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.381657] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.381733] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.385059] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.385059] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.385059] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.385059] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.385059] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.385059] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.385059] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.385059] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.385059] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.409637] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.409887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.409887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.410125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.410236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.410326] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be updated. [ 743.479249] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.479342] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.096 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.479476] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.480124] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-592" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.480124] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-997b31ab-299e-4874-94cd-d49f2dd01fa3 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.480247] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.480859] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.480859] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.480859] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('997b31ab-299e-4874-94cd-d49f2dd01fa3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.489131] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.489276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.489346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.489548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.489690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.503687] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: IN_PROGRESS for 2s [ 743.567872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 743.569321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.569678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.571879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.572035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.572316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.572685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.573053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.573267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.574034] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.663501] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 with status ACTIVE [ 743.663743] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.663852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.664015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.664149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.664242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.664423] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.664525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.664589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.664743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.664823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.665062] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.665140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.665198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.665343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.665507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.665507] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a994020-bb4a-4a3e-9d6e-8646f77a6ed5 is going to be updated. [ 743.690946] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.691170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.691170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.691373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.691509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.692881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a994020-bb4a-4a3e-9d6e-8646f77a6ed5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.986725] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.986894] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.986894] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.987537] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.987537] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.987537] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 997b31ab-299e-4874-94cd-d49f2dd01fa3 not found, creating... [ 743.987915] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.988176] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.988754] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.988754] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.988849] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.989484] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.989651] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.990166] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.990166] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.990381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.990551] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 997b31ab-299e-4874-94cd-d49f2dd01fa3 is going to be created. [ 744.012608] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.012827] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.012949] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.013254] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.013484] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.013701] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.075813] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.582092] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.722027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 744.722314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.045935] env[62815]: INFO networking_nsxv3.common.synchronization [req-fa848ff3-87c6-4dc4-901b-54d0a96e8e43 req-d23513a0-94f8-4fe6-8d09-b5b5ee4dd5af service nova] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 745.045935] env[62815]: INFO networking_nsxv3.common.synchronization [req-fa848ff3-87c6-4dc4-901b-54d0a96e8e43 req-d23513a0-94f8-4fe6-8d09-b5b5ee4dd5af service nova] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 745.045935] env[62815]: INFO networking_nsxv3.common.synchronization [req-fa848ff3-87c6-4dc4-901b-54d0a96e8e43 req-d23513a0-94f8-4fe6-8d09-b5b5ee4dd5af service nova] Enqueued Resource ID: 997b31ab-299e-4874-94cd-d49f2dd01fa3 with Priority: HIGHEST for action port [ 745.045935] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_rules [ 745.045935] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 745.045935] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 997b31ab-299e-4874-94cd-d49f2dd01fa3 with Priority: HIGHEST for action port [ 745.045935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.045935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.045935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.045935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.045935] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.046818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.046939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.047112] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-997b31ab-299e-4874-94cd-d49f2dd01fa3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.047218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.047279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.047657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.047739] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('997b31ab-299e-4874-94cd-d49f2dd01fa3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.083947] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.084192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.084192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.084866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.084866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.084866] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 745.111580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.111758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.111837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.112150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.112309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.121320] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 745.389835] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 745.390238] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 deletion is rescheduled due to dependency. [ 745.390238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.390426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.390605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.390790] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.390910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.390972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.391141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.391222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.391328] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.513055] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: SUCCESS [ 745.513299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.513553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.513697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.513888] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.514037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.514990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.514990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.514990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.514990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.514990] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.515657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.515657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.515749] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.515832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.519502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.519683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.519775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.519872] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.550867] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.551205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.551443] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 997b31ab-299e-4874-94cd-d49f2dd01fa3 with status ACTIVE [ 745.551624] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.551758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.551824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.552059] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.552156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.552329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.552426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.552489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.552635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.552710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.552886] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.552978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.553069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.553217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.553292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.553376] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 997b31ab-299e-4874-94cd-d49f2dd01fa3 is going to be updated. [ 745.576913] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.577144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.577246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.577492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.577724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.577928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-997b31ab-299e-4874-94cd-d49f2dd01fa3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.894099] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.022240] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.023582] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.396817] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.529828] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 901c46e1-fd02-475c-b557-4e4b01c2fc14: rpc.has_security_group_logging(os_id): False [ 746.531039] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.548312] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.548453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.548527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.548771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.548879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.549147] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.549253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.549318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.551169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.551169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.551169] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be updated. [ 746.608844] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.608993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.609079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.609445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.609445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.620471] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: IN_PROGRESS for 2s [ 746.901339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.901656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.901656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.901791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.901884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.901982] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be updated. [ 746.928981] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.930286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.930526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.931200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.931851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.939713] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 747.036535] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.036691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.036765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.036985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.037094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.037195] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be updated. [ 747.065164] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.065240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.065271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.065593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.065655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.076877] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: IN_PROGRESS for 2s [ 747.138263] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 747.138479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.138643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.139165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.139165] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.139356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.139356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.139418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.143028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.143028] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.647442] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.026778] env[62815]: INFO networking_nsxv3.common.synchronization [req-efb87737-7d94-45ee-9650-61edde4dfa0b req-c9275a1e-9702-4da7-b311-e99e6e77e1fb tempest-AttachInterfacesUnderV243Test-1897266101 tempest-AttachInterfacesUnderV243Test-1897266101-project-member] Enqueued Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 748.029104] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 with Priority: HIGHEST for action security_group_members [ 748.029104] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-901c46e1-fd02-475c-b557-4e4b01c2fc14 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.029104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.153150] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.634371] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: SUCCESS [ 748.634602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.634844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.635092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.635186] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.655739] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.655882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.655956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.656320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.656454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.656577] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 748.683494] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.683606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.683703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.683877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.684190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.692570] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 748.950179] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 748.950179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.950179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.950179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.950338] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.950395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.950971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.950971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.950971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.950971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.950971] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.086676] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 in Status: SUCCESS [ 749.086925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.087062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.087282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.087471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.087589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.087657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.087804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.087887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.088647] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.153879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.154031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.154106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.154353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.154493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.154604] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be deleted. [ 749.204447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.204616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.204692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.204904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.204993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.205131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.456590] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.578953] env[62815]: INFO networking_nsxv3.common.synchronization [req-38bfa682-0071-461f-8476-1b531cfbc26d req-4092594a-cc65-4ebc-b62a-79e40525dee9 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 749.579500] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 749.579802] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.579923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.579984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.580623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.580782] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.580909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.580977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.581154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.581252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.581344] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.590259] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.590387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.590458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.590638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.590729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.590908] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.591023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.591085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.591242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.591324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.591410] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 is going to be deleted. [ 749.647544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.648214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.650193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.650461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.650569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.650677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.650843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.651030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.651218] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.651349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.651435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.651572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.651674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.651767] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('901c46e1-fd02-475c-b557-4e4b01c2fc14',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.944587] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.944796] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.944932] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.945308] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.945703] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.945931] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.946498] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.946792] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.947133] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.947398] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.947538] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.947730] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.947834] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.947985] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.948156] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.948670] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.959032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a360f68-c409-4d28-9396-e41a05128638: rpc.has_security_group_logging(os_id): False [ 749.968888] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.969149] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.969368] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.969606] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.970040] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.970381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.970607] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.976232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.976232] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca1edea2-0302-447f-8bb1-6b3f7a53a46c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.976921] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.977054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.977140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.977346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.977441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.977686] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.977798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.977862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.981855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.981855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.981855] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be updated. [ 750.035816] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.036062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.036062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.036327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.036490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.049183] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 750.088027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.088027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.088027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 already deleted. [ 750.088027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.133455] env[62815]: INFO networking_nsxv3.common.synchronization [None req-0145ca90-2471-4bb6-99b1-0af30c2c5e97 None None] Enqueued Resource ID: 59d5c74d-0a1a-4548-ba71-c3c01f0ffc95 with Priority: HIGHEST for action port [ 750.133770] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59d5c74d-0a1a-4548-ba71-c3c01f0ffc95 with Priority: HIGHEST for action port [ 750.134393] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-59d5c74d-0a1a-4548-ba71-c3c01f0ffc95 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.134607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59d5c74d-0a1a-4548-ba71-c3c01f0ffc95" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.134607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59d5c74d-0a1a-4548-ba71-c3c01f0ffc95" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.134877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59d5c74d-0a1a-4548-ba71-c3c01f0ffc95" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.134973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d5c74d-0a1a-4548-ba71-c3c01f0ffc95',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.155059] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.156167] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.156167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.156554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.156554] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 901c46e1-fd02-475c-b557-4e4b01c2fc14 already deleted. [ 750.156554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-901c46e1-fd02-475c-b557-4e4b01c2fc14" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.484025] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.484025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port ca1edea2-0302-447f-8bb1-6b3f7a53a46c not found, creating... [ 750.484025] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.484025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.484577] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.484577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.484577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.484577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.485434] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.485956] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: ca1edea2-0302-447f-8bb1-6b3f7a53a46c is going to be created. [ 750.508883] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.508883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.508883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.508883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.508883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.508883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.638437] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59d5c74d-0a1a-4548-ba71-c3c01f0ffc95 [ 750.638714] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.638807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.638896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.639146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.639236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.639335] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59d5c74d-0a1a-4548-ba71-c3c01f0ffc95 already deleted. [ 750.639426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59d5c74d-0a1a-4548-ba71-c3c01f0ffc95" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.700440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 750.700745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.701151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.701258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.702190] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.702438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.702531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.702715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.702808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.702895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.703127] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.703371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.703371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.703483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.703886] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.703886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.703886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.704023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.704112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.704704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.704704] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.706731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.706896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.707064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.707169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 750.707240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.707399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 750.707603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 750.707603] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.184160] env[62815]: INFO networking_nsxv3.common.synchronization [None req-6ccebabd-ff38-4c55-8774-72609565245f tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 751.184520] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 751.184868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.184989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.186171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.186451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.186537] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.211353] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b341d199-0570-4483-a66b-c412fafde85f: rpc.has_security_group_logging(os_id): False [ 751.213496] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.230951] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.231469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.231680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.232136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.232352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.232669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.232948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.233141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.233438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.233708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.234034] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.234284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.234457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.234770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.237357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.237357] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.237357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.237357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.237357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.237357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.237357] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be created. [ 751.294119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.296120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.296120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.296120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.296120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.307019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 751.334768] env[62815]: INFO networking_nsxv3.common.synchronization [None req-7b86bb33-b221-47a7-bf87-9ecc66bc5f18 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 751.336393] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 751.337078] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.337078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.472897] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 751.473254] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:1 started [ 751.618166] env[62815]: INFO networking_nsxv3.common.synchronization [req-38bfa682-0071-461f-8476-1b531cfbc26d req-b11ad441-b057-45ba-b437-a3752ec85faf service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 751.618773] env[62815]: INFO networking_nsxv3.common.synchronization [req-38bfa682-0071-461f-8476-1b531cfbc26d req-b11ad441-b057-45ba-b437-a3752ec85faf service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 751.621039] env[62815]: INFO networking_nsxv3.common.synchronization [req-38bfa682-0071-461f-8476-1b531cfbc26d req-b11ad441-b057-45ba-b437-a3752ec85faf service nova] Enqueued Resource ID: ca1edea2-0302-447f-8bb1-6b3f7a53a46c with Priority: HIGHEST for action port [ 751.621039] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 751.621039] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 751.621039] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1edea2-0302-447f-8bb1-6b3f7a53a46c with Priority: HIGHEST for action port [ 751.621039] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.621039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.621039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.621039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.621039] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.622976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.622976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.622976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.622976] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.623858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.623955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.624046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.625653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.625653] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca1edea2-0302-447f-8bb1-6b3f7a53a46c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.706976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.707139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 751.707183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.707436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.707540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.707642] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 already deleted. [ 751.707713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 751.707864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.708031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 751.708129] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.724028] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.064446] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 752.064446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.126189] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.126346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.126542] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.127487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca1edea2-0302-447f-8bb1-6b3f7a53a46c with status ACTIVE [ 752.127684] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.127798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.127858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.128102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.128222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.128399] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.128510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.128574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.128711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.128775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.128959] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.129358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.129458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.129584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.129655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.129764] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca1edea2-0302-447f-8bb1-6b3f7a53a46c is going to be updated. [ 752.152680] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.152844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.152953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.153483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.153483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.153483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca1edea2-0302-447f-8bb1-6b3f7a53a46c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.226282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.226556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.226556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.226786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.226885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.226983] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 752.239568] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.239789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.239877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.240203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.240288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.240405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 already deleted. [ 752.240497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.275123] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.275295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.275348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.276229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.276229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.295121] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 752.542307] env[62815]: INFO networking_nsxv3.common.synchronization [None req-8d33719b-6482-4979-ab54-cb4a676d8bba None None] Enqueued Resource ID: f87bf566-a68d-4572-b570-de0c67cfd6b6 with Priority: HIGHEST for action port [ 752.542879] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87bf566-a68d-4572-b570-de0c67cfd6b6 with Priority: HIGHEST for action port [ 752.543201] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f87bf566-a68d-4572-b570-de0c67cfd6b6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.543320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f87bf566-a68d-4572-b570-de0c67cfd6b6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.543826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f87bf566-a68d-4572-b570-de0c67cfd6b6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.543826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f87bf566-a68d-4572-b570-de0c67cfd6b6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.543826] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f87bf566-a68d-4572-b570-de0c67cfd6b6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.632195] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.673947] env[62815]: INFO networking_nsxv3.common.synchronization [req-4834de5a-1e95-4d96-b32e-8d164e223003 req-90515e79-ca91-4264-86e6-00fb668caee1 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 752.675126] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 752.675475] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.675598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.675669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.675916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.676077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.676171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.676231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.676378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.677044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.677044] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.050771] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f87bf566-a68d-4572-b570-de0c67cfd6b6 [ 753.051031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.051178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.051250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.051472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.051565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.051656] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f87bf566-a68d-4572-b570-de0c67cfd6b6 already deleted. [ 753.051739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f87bf566-a68d-4572-b570-de0c67cfd6b6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.090345] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.090551] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.090678] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.090960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.091259] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.091396] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.091538] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.091724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.091866] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.092095] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.092240] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.092361] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.092496] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.092632] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.092727] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.092858] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.113133] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.113392] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.113569] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.113783] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.114175] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-0058f5c4-5efa-4a60-ae3e-a1c81146efed taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.114430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.114568] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.114915] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.116307] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0058f5c4-5efa-4a60-ae3e-a1c81146efed',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.137858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.138067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.138174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.138348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.138450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.138552] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be created. [ 753.159558] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.159725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.159796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.160052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.160269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.171461] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: UNINITIALIZED for 2s [ 753.179068] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.179222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.179328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.179589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.179704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.179909] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.180030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.180095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.180872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.180969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.181078] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 already deleted. [ 753.181167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.320196] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 753.320522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.320661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.320877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.320969] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.619054] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.619368] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.619565] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.619908] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.620111] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.620339] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 0058f5c4-5efa-4a60-ae3e-a1c81146efed not found, creating... [ 753.620703] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.620927] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.621121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.621389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.621541] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.622121] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.622309] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.622433] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.622672] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.622813] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.623094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 0058f5c4-5efa-4a60-ae3e-a1c81146efed is going to be created. [ 753.642444] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.642661] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.642788] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.643089] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.643348] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.643573] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.823114] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.823336] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.304684] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 754.304924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.305122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.305345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.305535] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.305798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.305798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.305945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.306049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.306139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.306234] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.347841] env[62815]: INFO networking_nsxv3.common.synchronization [req-4834de5a-1e95-4d96-b32e-8d164e223003 req-0b0227c2-fef4-475b-86fa-bba1d505a244 service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 754.348132] env[62815]: INFO networking_nsxv3.common.synchronization [req-4834de5a-1e95-4d96-b32e-8d164e223003 req-0b0227c2-fef4-475b-86fa-bba1d505a244 service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 754.348177] env[62815]: INFO networking_nsxv3.common.synchronization [req-4834de5a-1e95-4d96-b32e-8d164e223003 req-0b0227c2-fef4-475b-86fa-bba1d505a244 service nova] Enqueued Resource ID: 0058f5c4-5efa-4a60-ae3e-a1c81146efed with Priority: HIGHEST for action port [ 754.348423] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 754.348557] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 754.348656] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0058f5c4-5efa-4a60-ae3e-a1c81146efed with Priority: HIGHEST for action port [ 754.349201] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.349330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.349399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.349657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.349725] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.352180] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.352508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.352508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.352656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.352848] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.352998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.353384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.353384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.353384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.353582] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.354448] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0058f5c4-5efa-4a60-ae3e-a1c81146efed taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.354604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.354703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.354892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.354999] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0058f5c4-5efa-4a60-ae3e-a1c81146efed',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.809071] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.809241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.809303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.809619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.809816] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.809922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.809989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.810188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.810277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.810373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.810520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.810615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.810675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.810818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.810963] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.811120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.811186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.811312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.811394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.811478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.811566] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.856813] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.857676] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.860424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.860424] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0058f5c4-5efa-4a60-ae3e-a1c81146efed with status ACTIVE [ 754.860424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.860424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.860424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.860424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.860424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.860424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.861032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.861032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.861032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.861032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.861032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.861032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.861032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.861326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.861326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.861326] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0058f5c4-5efa-4a60-ae3e-a1c81146efed is going to be updated. [ 754.882623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.882623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 754.882623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.882623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 754.882623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 754.882966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0058f5c4-5efa-4a60-ae3e-a1c81146efed" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.185932] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 755.185932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.186109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.186321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.186516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.186662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.186702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.186856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.186936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.187040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.187136] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.314204] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b341d199-0570-4483-a66b-c412fafde85f: rpc.has_security_group_logging(os_id): False [ 755.332031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.332239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.332239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.333329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.333329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.333329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.333329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.333329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.333329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.333329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.336533] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.336650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.336706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.336944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.336944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.337404] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.337404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.337404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.337578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.337578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.337649] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 755.358523] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.394679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.394767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.395072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.395072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.395237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.406484] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 755.689530] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.689781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.689898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.690762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.691231] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.691411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.691605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.691868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.692220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.692373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.692584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.692716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.692798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.693148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.693341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.693900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.694041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.694394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.694517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.694654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.694787] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.860935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.861150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.861196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.861416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.861508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.861627] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be created. [ 755.883892] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.884107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 755.884156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.884364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 755.884545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 755.893393] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: UNINITIALIZED for 2s [ 756.197138] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95315c29-36f4-4fb3-afae-f96b062c5650: rpc.has_security_group_logging(os_id): False [ 756.215072] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.215231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.215304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.216126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.216126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.216126] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.216126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.216126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.216557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.216557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.216656] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.216751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.216821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.216996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.217521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.217521] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.217521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.217521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.217833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.217833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.217833] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be created. [ 756.273026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.273026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.273026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.273268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.273305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.283502] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 756.634687] env[62815]: INFO networking_nsxv3.common.synchronization [req-fd3b7285-cc18-4dca-a89e-e06923288193 req-808f47f3-d0d0-4d32-90db-f7cf30d6ad50 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 756.635025] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 756.635331] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.636078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.636078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.636078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.636227] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.636293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.636351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.636473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.636573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.636667] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.126782] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.127343] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.127519] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.127916] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.128255] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.128419] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.128562] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.128830] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.128981] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.129246] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.129372] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.129482] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.129609] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.129733] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.129861] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.130015] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.138812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.138974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.139047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.139265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.139357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.139869] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.139869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.139869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.140079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.140122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.140261] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b already deleted. [ 757.140354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.147597] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.147765] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.147906] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.148170] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.148543] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-24bb89d0-848a-4a34-b349-1e8af9692566 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.148713] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.148797] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.149371] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.149575] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24bb89d0-848a-4a34-b349-1e8af9692566',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.419682] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 757.420056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.420394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.420707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.420858] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.652082] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.652380] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.652453] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.652753] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.652940] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.653070] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 24bb89d0-848a-4a34-b349-1e8af9692566 not found, creating... [ 757.653348] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.653508] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.653627] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.653843] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.653981] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.654280] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.654436] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.654554] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.654755] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.654889] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.655286] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 24bb89d0-848a-4a34-b349-1e8af9692566 is going to be created. [ 757.674729] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.675069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.675241] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.675546] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.675909] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.676220] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.903664] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 757.903664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.903803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.903939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.904101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.904226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.904295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.904448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.904531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.904616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.904710] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.925982] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.925982] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.925982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.925982] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.294281] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 758.294499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.363459] env[62815]: INFO networking_nsxv3.common.synchronization [req-fd3b7285-cc18-4dca-a89e-e06923288193 req-c52e0f8b-5987-416d-a902-15dc29f515ee service nova] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 758.363514] env[62815]: INFO networking_nsxv3.common.synchronization [req-fd3b7285-cc18-4dca-a89e-e06923288193 req-c52e0f8b-5987-416d-a902-15dc29f515ee service nova] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 758.363654] env[62815]: INFO networking_nsxv3.common.synchronization [req-fd3b7285-cc18-4dca-a89e-e06923288193 req-c52e0f8b-5987-416d-a902-15dc29f515ee service nova] Enqueued Resource ID: 24bb89d0-848a-4a34-b349-1e8af9692566 with Priority: HIGHEST for action port [ 758.364181] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 758.364319] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 758.364497] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24bb89d0-848a-4a34-b349-1e8af9692566 with Priority: HIGHEST for action port [ 758.364669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.364792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.364846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.365147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.365230] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.366020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.366126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.366190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.366348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.366485] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.366609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.366642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.368498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.368498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.368498] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.368498] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-24bb89d0-848a-4a34-b349-1e8af9692566 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.368498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.368498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.368498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.368498] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24bb89d0-848a-4a34-b349-1e8af9692566',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.408188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.408188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.408188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.408188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.408703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.408703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.408703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.408703] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.408703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.408967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.408967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.408967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.409121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.409121] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.430049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.430049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.430049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.430049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.430049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.430049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.430424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.430424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.430424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.430510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.430650] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.430719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.430781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.430937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.431086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.431200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.431257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.431425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.431519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.431604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.431692] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.870762] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.871887] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.872102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.872166] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24bb89d0-848a-4a34-b349-1e8af9692566 with status ACTIVE [ 758.872326] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.872466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.872529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.872706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.872799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.872963] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.873155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.873246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.873398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.873446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.873681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.873773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.873773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.873888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.873962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.874050] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24bb89d0-848a-4a34-b349-1e8af9692566 is going to be updated. [ 758.900385] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.900491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.900535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.900738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.900880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.901056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.910864] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d6bbb76-6d82-445e-a124-2538b600ecb4: rpc.has_security_group_logging(os_id): False [ 758.929432] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.929626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.929703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.930108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.930310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.930607] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.930741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.930864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.931073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.931144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.931416] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.931576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.931613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.931756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.931832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.932372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.932372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.932372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.932372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.932695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.932695] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be created. [ 758.934271] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b341d199-0570-4483-a66b-c412fafde85f: rpc.has_security_group_logging(os_id): False [ 758.955044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.955044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.955286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.955345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.955465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.955789] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.955918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.955988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.956202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.956352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.956586] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.956734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.956813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.957053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.957164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.957381] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.957537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.957641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.957831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.957940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.957989] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 759.043284] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.043452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.043576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.043745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.044032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.064967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.065798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.065798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.065798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.065798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.069235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 759.081492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 759.376425] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.881749] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.882089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.882089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.882268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.882365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.882532] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be created. [ 759.905459] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.905617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.905692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.905887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.906054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.915160] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: UNINITIALIZED for 2s [ 761.081177] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 761.081717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.092128] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 761.092417] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.924840] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 761.925140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.925231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.925445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.925634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.925993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 761.925993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.925993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 761.926139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.926139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 761.926260] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.431780] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.431780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.431780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.432223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.432223] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.432306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.432306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.432878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.432878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.432878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.432878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.433162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.433162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.433162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.433506] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.433506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.433506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.433691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.433691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.433777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.433832] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.936327] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6d0cd-3c56-42cd-8d37-8158526e935b: rpc.has_security_group_logging(os_id): False [ 762.953922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.954109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.954156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.954418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.954491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.954677] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.954837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.954923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.955096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.955177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.955364] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.955459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.955520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.955660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.955735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.955916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.956016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 762.956081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.956220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 762.956297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 762.956378] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be created. [ 763.013102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.013254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 763.013322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.013546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 763.013732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 763.024675] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 763.366950] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 763.367113] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 764.417286] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-1787d0c2-5022-4015-8816-3c678aa1dca8 tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 764.417817] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 764.418341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.418428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.418428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.418623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.418772] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.418858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.418921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.419204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.419356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.419483] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.922012] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.922295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.922427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.922691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.923015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.923319] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.925367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.925367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.925367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.925367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.925367] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 764.952113] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.952265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.952348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.952548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.952689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.962660] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 764.974287] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.974287] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.974287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.974944] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.975199] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.975422] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.975682] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.975939] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.976171] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.976416] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.996019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.996019] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.996019] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.996019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.996019] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-ffcd6837-1f0c-46f3-81a7-ba63548344a6 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.996019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 764.996019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.996587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 764.996889] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffcd6837-1f0c-46f3-81a7-ba63548344a6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.069263] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 765.069472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.499528] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.499823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.499901] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.500186] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.500398] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.500558] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port ffcd6837-1f0c-46f3-81a7-ba63548344a6 not found, creating... [ 765.500845] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.501015] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.501140] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.501361] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.501501] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.501805] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.501963] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.502324] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.502610] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.502804] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.502974] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: ffcd6837-1f0c-46f3-81a7-ba63548344a6 is going to be created. [ 765.509044] env[62815]: INFO networking_nsxv3.common.synchronization [None req-69c4e167-73c9-4512-92ea-2a0de56f904f None None] Enqueued Resource ID: c02015fb-1426-4da2-bd5e-0d60b6da4f62 with Priority: HIGHEST for action port [ 765.509044] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c02015fb-1426-4da2-bd5e-0d60b6da4f62 with Priority: HIGHEST for action port [ 765.509044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c02015fb-1426-4da2-bd5e-0d60b6da4f62 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.509224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c02015fb-1426-4da2-bd5e-0d60b6da4f62" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.509224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c02015fb-1426-4da2-bd5e-0d60b6da4f62" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.512019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c02015fb-1426-4da2-bd5e-0d60b6da4f62" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.512019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c02015fb-1426-4da2-bd5e-0d60b6da4f62',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.527017] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.527222] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.527366] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.527633] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.528335] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.528335] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.991979] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 765.992358] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 765.993041] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 765.993303] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 765.993729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.994079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.994414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.998019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.998019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.998019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.998019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 765.998019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 765.998019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.012156] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c02015fb-1426-4da2-bd5e-0d60b6da4f62 [ 766.013817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.013817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.013817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.013817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.013817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.013817] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c02015fb-1426-4da2-bd5e-0d60b6da4f62 already deleted. [ 766.013817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c02015fb-1426-4da2-bd5e-0d60b6da4f62" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.066075] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 766.066387] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 766.066575] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_rules [ 766.066791] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 766.067012] env[62815]: INFO networking_nsxv3.common.synchronization [req-51fe633d-5e4e-4b83-b0ae-6690bc5dc598 req-4b6d40dc-5de8-456b-923a-744f4e456df2 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 24bb89d0-848a-4a34-b349-1e8af9692566 with Priority: HIGHEST for action port [ 766.070209] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 766.070209] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_rules [ 766.070209] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24bb89d0-848a-4a34-b349-1e8af9692566 with Priority: HIGHEST for action port [ 766.070209] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 766.070209] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 766.070209] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.070209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.070209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.070209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.070209] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.070936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.071479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.071479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.071749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.071807] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.072881] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-24bb89d0-848a-4a34-b349-1e8af9692566 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.075019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.075019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.075019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.075019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24bb89d0-848a-4a34-b349-1e8af9692566',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.075019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.075019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.075340] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.075340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.455075] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-89a3c595-84be-4cdb-85b7-8ea99d9bc5f2 service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 766.455271] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-89a3c595-84be-4cdb-85b7-8ea99d9bc5f2 service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 766.455413] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-89a3c595-84be-4cdb-85b7-8ea99d9bc5f2 service nova] Enqueued Resource ID: ffcd6837-1f0c-46f3-81a7-ba63548344a6 with Priority: HIGHEST for action port [ 766.455644] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 766.455768] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 766.455865] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffcd6837-1f0c-46f3-81a7-ba63548344a6 with Priority: HIGHEST for action port [ 766.456407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.456561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.456638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.456835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.456917] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.459699] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.459699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.459699] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffcd6837-1f0c-46f3-81a7-ba63548344a6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.459699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.459699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.459699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.459699] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffcd6837-1f0c-46f3-81a7-ba63548344a6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.502347] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.503220] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.551757] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_members [ 766.551952] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 766.552708] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 766.552928] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_members [ 766.553049] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 766.553210] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 766.553594] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.553776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.553888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.554279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.554470] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.554631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.554729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.554994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.555171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.555352] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.556291] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.556373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.556518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.556603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.576734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.576881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.577105] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.577183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.583649] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24bb89d0-848a-4a34-b349-1e8af9692566 with status ACTIVE [ 766.583649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.583649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.583649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.583649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.583649] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24bb89d0-848a-4a34-b349-1e8af9692566 is going to be updated. [ 766.606524] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.606672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.606767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.606995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.607154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.607313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.781418] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_rules [ 766.781612] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_members [ 766.781758] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 766.781899] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 766.784137] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_rules [ 766.784626] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 766.784626] env[62815]: INFO networking_nsxv3.common.synchronization [req-4c237d41-0f75-4714-8be1-13d4e9ff521f req-2972ac20-e01e-4394-b3ec-2f0a9a144c95 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 24bb89d0-848a-4a34-b349-1e8af9692566 with Priority: HIGHEST for action port [ 766.785133] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_rules [ 766.785280] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 766.785413] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 766.785472] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24bb89d0-848a-4a34-b349-1e8af9692566 with Priority: HIGHEST for action port [ 766.785701] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_rules [ 766.785701] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_members [ 766.785821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 766.786008] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.786137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.786205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.786465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.786551] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.787418] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.787542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.787966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.787966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.787966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-24bb89d0-848a-4a34-b349-1e8af9692566 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.789627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.789711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.790459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.790459] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24bb89d0-848a-4a34-b349-1e8af9692566',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.791664] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.791739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.792104] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.792157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.792503] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.792723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.961791] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.961791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.963347] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffcd6837-1f0c-46f3-81a7-ba63548344a6 with status ACTIVE [ 766.963347] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.963758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.963894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.967469] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.967469] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.967469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.967989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.967989] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffcd6837-1f0c-46f3-81a7-ba63548344a6 is going to be updated. [ 766.977373] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 766.977373] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e deletion is rescheduled due to dependency. [ 766.977373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.977670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.977670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.977919] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.977991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.978034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.980019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.980019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.980019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.990475] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.990475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.990475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.990475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.990475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.990475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffcd6837-1f0c-46f3-81a7-ba63548344a6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.009773] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.010729] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.057549] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.183428] env[62815]: INFO networking_nsxv3.common.synchronization [req-e68b439c-eea5-4602-9f50-164664c53b0e req-70adc993-ba7a-4fb4-9724-91a3a8b264a2 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 767.183428] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 767.185403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.185403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.185403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.185403] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.295799] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.295981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.296302] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24bb89d0-848a-4a34-b349-1e8af9692566 with status ACTIVE [ 767.296435] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.296545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.296604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.296948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.296948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.297095] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.297180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.297247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.297386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.297454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.297636] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.297742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.297802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.297904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.297971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.298059] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24bb89d0-848a-4a34-b349-1e8af9692566 is going to be updated. [ 767.301434] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-d7b1d1f3-fbe5-44fc-9f3e-c988dc767f99 tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 767.302147] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 767.302769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.302884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.342384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.342384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.342384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.342384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.342384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.342384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24bb89d0-848a-4a34-b349-1e8af9692566" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.483842] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.511890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.512268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.512398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.512827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.512928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.513043] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be created. [ 767.517492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.517659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.517730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.517924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.518026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.518141] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 767.551679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.552111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.552197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.552448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.552625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.558362] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.558362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.558362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.558362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.558362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.559327] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.564836] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 767.565555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: UNINITIALIZED for 2s [ 767.688718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.688889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.688961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.689210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.689314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.689511] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.689604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.689663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.689852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.690166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.690311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 767.740845] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.741028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.741117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.741394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.742386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.754219] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 767.882678] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-999 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.882942] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.883123] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.883486] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.883808] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.884283] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.884540] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.886330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.886330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.886330] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.886330] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.886330] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.886330] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.886330] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.886330] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.886692] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.903734] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.903994] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.904204] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.904450] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 767.904858] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-717cf509-41f5-4060-b905-72d6436b2f4c taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.905122] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.905293] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.905660] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.905842] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717cf509-41f5-4060-b905-72d6436b2f4c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.944393] env[62815]: INFO networking_nsxv3.common.synchronization [None req-1d16f210-d30f-402b-94c5-82855e91b2a5 None None] Enqueued Resource ID: 0c97285d-c209-4b47-a2ae-b73c57fa87c5 with Priority: HIGHEST for action port [ 767.944393] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c97285d-c209-4b47-a2ae-b73c57fa87c5 with Priority: HIGHEST for action port [ 767.944393] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c97285d-c209-4b47-a2ae-b73c57fa87c5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.944393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c97285d-c209-4b47-a2ae-b73c57fa87c5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 767.944393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c97285d-c209-4b47-a2ae-b73c57fa87c5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.944627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c97285d-c209-4b47-a2ae-b73c57fa87c5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 767.944627] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c97285d-c209-4b47-a2ae-b73c57fa87c5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.985694] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.061339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.061525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.061582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.061779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.061872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.061972] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 is going to be created. [ 768.083773] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.083911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.083979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.084688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.084903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.093577] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: UNINITIALIZED for 2s [ 768.409039] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.409039] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.409276] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.409478] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.409637] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.409789] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 717cf509-41f5-4060-b905-72d6436b2f4c not found, creating... [ 768.410082] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.410279] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.410448] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.410692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.410831] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.411123] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.411278] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.411410] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.411601] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.411735] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.411897] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 717cf509-41f5-4060-b905-72d6436b2f4c is going to be created. [ 768.432110] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.432373] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.432521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.432892] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.433181] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.433447] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.449249] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c97285d-c209-4b47-a2ae-b73c57fa87c5 [ 768.449559] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.449741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.449836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.450098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.450210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.450366] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c97285d-c209-4b47-a2ae-b73c57fa87c5 already deleted. [ 768.450461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c97285d-c209-4b47-a2ae-b73c57fa87c5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.488967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.489160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.489230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.489459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.489554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.489668] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 768.545929] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.546246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.546246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.546421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.546571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.558313] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 769.581388] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 769.581644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.582505] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 769.582644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.582801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.583014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.583209] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.583323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.583391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.583547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.583627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.583722] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.586577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.587465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.587465] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.587465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.587465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.587465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.587465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.587465] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.719311] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-962bdfbf-3ac7-4a60-b266-033bdfd98003 service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 769.719469] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-962bdfbf-3ac7-4a60-b266-033bdfd98003 service nova] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 769.719623] env[62815]: INFO networking_nsxv3.common.synchronization [req-4a8b3de0-3762-486a-8bb8-4f9a7090901c req-962bdfbf-3ac7-4a60-b266-033bdfd98003 service nova] Enqueued Resource ID: 717cf509-41f5-4060-b905-72d6436b2f4c with Priority: HIGHEST for action port [ 769.720167] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_rules [ 769.720341] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 769.720449] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717cf509-41f5-4060-b905-72d6436b2f4c with Priority: HIGHEST for action port [ 769.720722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.720881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.721053] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.721166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.721576] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-717cf509-41f5-4060-b905-72d6436b2f4c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.721576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.721576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.721753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.721787] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717cf509-41f5-4060-b905-72d6436b2f4c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.768811] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 769.770699] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 deletion is rescheduled due to dependency. [ 769.770846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.090640] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.092018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.104364] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: SUCCESS [ 770.104570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.105385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.105628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.105834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.105974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.106062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.106275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.106383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.106556] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.153753] env[62815]: INFO networking_nsxv3.common.synchronization [req-25a24bc4-9dd1-4bf0-b708-8d2dc461339a req-d65fcbc6-fa78-4466-b1e5-aa98b2936f9f tempest-ServersTestManualDisk-455940675 tempest-ServersTestManualDisk-455940675-project-member] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_members [ 770.154952] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_members [ 770.159331] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.159331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.161033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.161033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.161033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.161033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.161033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.161033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.161703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.161703] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.223813] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 717cf509-41f5-4060-b905-72d6436b2f4c with status ACTIVE [ 770.223994] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.224149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.224225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.224442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.224514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.224683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.225574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.225574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.225574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.225574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.225574] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.225574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.225574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.226187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.226187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.226187] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 717cf509-41f5-4060-b905-72d6436b2f4c is going to be updated. [ 770.251291] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.251497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.251497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.252037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.252037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.252037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-717cf509-41f5-4060-b905-72d6436b2f4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.567869] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.571026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.571026] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.571026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.571026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.571664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.571664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.571740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.572171] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.594041] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.597075] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.613306] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.665565] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.665972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.666451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.666785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.666962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.667456] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.667456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.667456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.667646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.667646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.667721] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 already deleted. [ 770.667825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.717213] env[62815]: INFO networking_nsxv3.common.synchronization [req-d75a1b84-02a7-45f2-8cbe-5bf71640e0b3 req-4e241f10-041c-4016-aecb-74272335a6e1 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_members [ 770.717752] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGHEST for action security_group_members [ 770.718520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.718520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.718520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.719011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.720688] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.720688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.720827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.721342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.721342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.721342] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.738697] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-672 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.741970] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-672" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.742118] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-672" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.742481] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-672" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.742838] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.743019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.743166] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.743417] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.743578] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.743813] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.743937] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.744064] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.744177] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.744302] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.744412] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.744551] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.764700] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.764867] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.765091] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.765481] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-672" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.765559] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-30316f8a-f0f8-4429-b097-9e349d0ea2a2 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.765696] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.765853] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.766274] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.766399] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30316f8a-f0f8-4429-b097-9e349d0ea2a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.072074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.072351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.073670] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.096951] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.097117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.097193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.097420] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.097528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.097627] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be updated. [ 771.099518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.099688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.099761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.099939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.100053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.100146] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 771.113100] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.135589] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.136696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.136696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.136696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.136696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.142041] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.142782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.142782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.142782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.142782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.153849] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: IN_PROGRESS for 2s [ 771.154640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 771.225039] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.225039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.225039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.225261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.225389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.225683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.225801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.225865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.226044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.226132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.226224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d is going to be updated. [ 771.252813] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.253016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.253118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.253366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.253569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.262023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2c257cd-88aa-41f2-80e5-a79e264a317d in Status: IN_PROGRESS for 2s [ 771.269596] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.269828] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.270432] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.270432] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.270595] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.270632] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 30316f8a-f0f8-4429-b097-9e349d0ea2a2 not found, creating... [ 771.270886] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.271068] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.271190] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.271443] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.271659] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.272007] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.272212] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.272369] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.272661] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.272839] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.272998] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 30316f8a-f0f8-4429-b097-9e349d0ea2a2 is going to be created. [ 771.293589] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.293876] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.294017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.294403] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.294656] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.294933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.576475] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.615571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.615965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.615965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.616181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.616279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.616380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 is going to be updated. [ 771.646524] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.646629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.646684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.646933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.647275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.657789] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: IN_PROGRESS for 2s [ 772.034950] env[62815]: INFO networking_nsxv3.common.synchronization [req-25a24bc4-9dd1-4bf0-b708-8d2dc461339a req-21d750cc-2fca-4816-9ac0-1b466fef4c2b service nova] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_rules [ 772.035187] env[62815]: INFO networking_nsxv3.common.synchronization [req-25a24bc4-9dd1-4bf0-b708-8d2dc461339a req-21d750cc-2fca-4816-9ac0-1b466fef4c2b service nova] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_members [ 772.035350] env[62815]: INFO networking_nsxv3.common.synchronization [req-25a24bc4-9dd1-4bf0-b708-8d2dc461339a req-21d750cc-2fca-4816-9ac0-1b466fef4c2b service nova] Enqueued Resource ID: 30316f8a-f0f8-4429-b097-9e349d0ea2a2 with Priority: HIGHEST for action port [ 772.035735] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_rules [ 772.035735] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_members [ 772.035848] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30316f8a-f0f8-4429-b097-9e349d0ea2a2 with Priority: HIGHEST for action port [ 772.036421] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.036549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.036610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.036852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.036894] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.038028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.038028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.038028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.038203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.038283] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.038392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.038488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.040783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.040783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.040783] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.040783] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-30316f8a-f0f8-4429-b097-9e349d0ea2a2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.040783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.040783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.040783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.040783] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30316f8a-f0f8-4429-b097-9e349d0ea2a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.081544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.081544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.081544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.081544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.081544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.081544] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 772.110979] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.111230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.111335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.111615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.111923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.122286] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 772.542434] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.543557] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.543685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.543827] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30316f8a-f0f8-4429-b097-9e349d0ea2a2 with status ACTIVE [ 772.544029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.544131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.544184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.544363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.544473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.544602] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.544694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.544757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.544900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.544977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.545165] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.545256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.545307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.545450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.545524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.545605] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30316f8a-f0f8-4429-b097-9e349d0ea2a2 is going to be updated. [ 772.565882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.566089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.566138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.566320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.566452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.566614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30316f8a-f0f8-4429-b097-9e349d0ea2a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.736959] env[62815]: INFO networking_nsxv3.common.synchronization [req-4d56193e-2c48-45b8-9214-cd556a43e519 req-043a7d6c-df8b-4cf2-99fe-e0e3f9261056 tempest-ListServerFiltersTestJSON-1707760047 tempest-ListServerFiltersTestJSON-1707760047-project-member] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 772.737560] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 772.737899] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.740014] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.740014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.740014] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.047647] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.165742] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 773.166082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.166333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.166649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.166943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.167143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.167337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.167461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.167608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.167741] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.170059] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 773.170173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.170351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.170606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.170846] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.171044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.171150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.171387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.171652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.171652] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.242554] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.271076] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2c257cd-88aa-41f2-80e5-a79e264a317d in Status: SUCCESS [ 773.271337] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d deletion is rescheduled due to dependency. [ 773.271523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.550743] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.551020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.551020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.551235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.551440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.551542] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 is going to be created. [ 773.575626] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.575870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.575870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.576115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.576341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.585467] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: UNINITIALIZED for 2s [ 773.667492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: IN_PROGRESS for 4s [ 773.674088] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.675237] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.745102] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.130980] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 774.131174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.131426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.131609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.131795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.131908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.131972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.132135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.132228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.132315] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.178908] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.179862] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.247991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.248256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.248256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.248374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.248458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.248563] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 774.274716] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.274898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.274973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.275199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.275526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.283748] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 774.635105] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.681606] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.681851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.681851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.682074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.682167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.682269] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be updated. [ 774.683628] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.683766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.683824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.684009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.684151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.684192] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 774.709899] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.710131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.710131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.710346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.710506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.712681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.712863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.712863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.713058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.713177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.733786] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 774.734540] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: IN_PROGRESS for 2s [ 774.861588] env[62815]: INFO networking_nsxv3.common.synchronization [req-74aad092-8f83-43db-b561-b968fa129172 req-7f7795de-d160-4d88-90cd-9ccd90bd4c76 tempest-ServersAdminNegativeTestJSON-39006248 tempest-ServersAdminNegativeTestJSON-39006248-project-member] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 774.861588] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 774.861588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.861588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.861588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.861588] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.137656] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.186994] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.187315] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.187409] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.187757] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.188051] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.188219] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.188355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.188614] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.188759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.188991] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.189140] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.189236] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.189346] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.189495] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.189578] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.189711] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.208075] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.208297] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.208449] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.208660] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-111" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.208988] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-724e8c5f-8587-4380-98e7-4a22a4881e98 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.209208] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.209340] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.209813] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.209972] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724e8c5f-8587-4380-98e7-4a22a4881e98',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.366722] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.595121] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: SUCCESS [ 775.595364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.595571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.595784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.595989] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.596136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.596202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.596356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.596430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.596534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.596625] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.639311] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.639518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.639644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.639905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.640040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.640183] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 775.665801] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.665961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.666046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.666285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.666434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.674157] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: SUCCESS [ 775.674374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.674963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.675133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.675335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.675453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.675532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.675689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.675784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.675872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.675961] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.677371] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 775.712686] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.712941] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.713087] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.713368] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.713538] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.713704] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 724e8c5f-8587-4380-98e7-4a22a4881e98 not found, creating... [ 775.713979] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.714167] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.714287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.714518] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.714671] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.714954] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.715148] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.715285] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.715493] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.715640] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.715871] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 724e8c5f-8587-4380-98e7-4a22a4881e98 is going to be created. [ 775.754664] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.754944] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.755137] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.755511] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.755810] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.756086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.868817] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.099285] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.178600] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.292999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 776.293315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.371680] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.371923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.371975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.372250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.372371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.372623] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be updated. [ 776.400008] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.400231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.400346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.400633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.400798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.410354] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 776.427182] env[62815]: INFO networking_nsxv3.common.synchronization [req-74aad092-8f83-43db-b561-b968fa129172 req-ee60acf1-38f5-4466-a05c-f25e584e5c46 service nova] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_rules [ 776.427397] env[62815]: INFO networking_nsxv3.common.synchronization [req-74aad092-8f83-43db-b561-b968fa129172 req-ee60acf1-38f5-4466-a05c-f25e584e5c46 service nova] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 776.427576] env[62815]: INFO networking_nsxv3.common.synchronization [req-74aad092-8f83-43db-b561-b968fa129172 req-ee60acf1-38f5-4466-a05c-f25e584e5c46 service nova] Enqueued Resource ID: 724e8c5f-8587-4380-98e7-4a22a4881e98 with Priority: HIGHEST for action port [ 776.427835] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_rules [ 776.427964] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 776.428091] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724e8c5f-8587-4380-98e7-4a22a4881e98 with Priority: HIGHEST for action port [ 776.428758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.428989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.428989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.429185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.429267] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.430143] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.430257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.430523] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-724e8c5f-8587-4380-98e7-4a22a4881e98 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.430632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.430712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.430889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.430979] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724e8c5f-8587-4380-98e7-4a22a4881e98',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.603201] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a03c29c0-c680-419e-9d7c-4307d6fd5fd7: rpc.has_security_group_logging(os_id): False [ 776.620682] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.620914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.620969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.621278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.621435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.621742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.621848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.621914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.622100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.622182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.622285] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 is going to be created. [ 776.675028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.675245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.675293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.675569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.675925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.680988] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ba85b5f-4e58-41b0-b69c-fab3d71be927: rpc.has_security_group_logging(os_id): False [ 776.691596] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: IN_PROGRESS for 2s [ 776.698064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.698336] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.698433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.698659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.698760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.699159] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.699276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.699343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.699512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.699593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.699712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 is going to be created. [ 776.756542] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 776.756835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.757053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.757313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.757559] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.757721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.757790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.758013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.758161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.758291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.758400] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.759959] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 776.760154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.760302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.760530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.760710] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.760835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.760901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.761079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.761202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.761349] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.762213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.762418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.762745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.762845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.762845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.763064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.763228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.763302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.763419] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.764747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.764992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.765250] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.765428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.765554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.765777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.765903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.766079] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.783523] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.783769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.783873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.784032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.784295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.799247] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: IN_PROGRESS for 2s [ 776.934691] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.935022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.935246] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 724e8c5f-8587-4380-98e7-4a22a4881e98 with status ACTIVE [ 776.935567] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.935699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.935802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.935978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.936083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.936328] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.936493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.936607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.936871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.936978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.937166] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.937298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.937410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.937650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.937727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.937815] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 724e8c5f-8587-4380-98e7-4a22a4881e98 is going to be updated. [ 776.960249] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.960765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.960765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.960941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.961079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.961211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-724e8c5f-8587-4380-98e7-4a22a4881e98" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.191030] env[62815]: INFO networking_nsxv3.common.synchronization [req-cab13776-1e13-4c40-801b-caf1994ae364 req-d1c3fc6d-c939-4f81-9cbb-639aa2657573 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 777.191030] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 777.191396] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.191517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.191587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.191787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.191945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.192090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.192155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.192308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.192397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.192492] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.264980] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.265918] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.267265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.267433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.269168] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.628771] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.628984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.629107] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.631657] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.632133] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.632404] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.632594] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.633028] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.633258] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.633646] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.633790] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.633965] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.634185] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.634284] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.634444] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.634640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.655152] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.655335] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.655488] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.655668] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.655982] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-b3b03e07-779a-4752-ab34-78d602257f1f taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.656172] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.656309] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.656677] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.656953] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b03e07-779a-4752-ab34-78d602257f1f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.687656] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 777.687852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.688045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.688264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.688468] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.688585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.688643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.688873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.689021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.690230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.690230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.690230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.690230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.690230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.690230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.690230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.690604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.690768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.690874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.691041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.691194] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.694027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.697037] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.697037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.697037] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 777.718612] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.718754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.718826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.719058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.719203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.727423] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 777.767318] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.768413] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for faad13ba-ac02-4335-855b-47b1737205ca: rpc.has_security_group_logging(os_id): False [ 777.770488] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.786840] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.787031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.787079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.787255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.787349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.787560] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.787660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.787722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.787869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.788346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.788346] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be created. [ 777.850796] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.851164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.851242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.853345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.853345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.863275] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: IN_PROGRESS for 2s [ 778.159998] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.159998] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.159998] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.160519] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.160519] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.160673] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port b3b03e07-779a-4752-ab34-78d602257f1f not found, creating... [ 778.160904] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.161078] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.161199] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.161510] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.161650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.161933] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.162103] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.162219] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.162431] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.162565] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.162700] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: b3b03e07-779a-4752-ab34-78d602257f1f is going to be created. [ 778.195228] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a93e2c7-70fc-4898-bef6-476829a0870e: rpc.has_security_group_logging(os_id): False [ 778.202087] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.202087] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.202087] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.202333] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.202609] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.202789] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.214243] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.214405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.214405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.214599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.214688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.214871] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.215095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.215095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.215289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.215289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.215550] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.215550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.215656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.215804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.215875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.215994] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.216161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.216396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.216572] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 778.272311] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.272311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.272482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.272843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.272843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.272843] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be updated. [ 778.274507] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.274507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.274507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.274507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.274507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.274780] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 778.310086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.310086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.310086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.310086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.310086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.329646] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 778.348021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.348021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.348021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.348021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.348021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.349527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.349804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.349997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.350287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.350615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.361387] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 778.362332] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: IN_PROGRESS for 2s [ 778.426126] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 778.426366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.426542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.426764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.426954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.427085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.427160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.427353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.427545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.427727] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.706375] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: SUCCESS [ 778.706691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.810803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: SUCCESS [ 778.811038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.884456] env[62815]: INFO networking_nsxv3.common.synchronization [req-cab13776-1e13-4c40-801b-caf1994ae364 req-aa88f2e4-04f0-4ff5-adc8-cf75debf1bb2 service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 778.884692] env[62815]: INFO networking_nsxv3.common.synchronization [req-cab13776-1e13-4c40-801b-caf1994ae364 req-aa88f2e4-04f0-4ff5-adc8-cf75debf1bb2 service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 778.884913] env[62815]: INFO networking_nsxv3.common.synchronization [req-cab13776-1e13-4c40-801b-caf1994ae364 req-aa88f2e4-04f0-4ff5-adc8-cf75debf1bb2 service nova] Enqueued Resource ID: b3b03e07-779a-4752-ab34-78d602257f1f with Priority: HIGHEST for action port [ 778.885542] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 778.885804] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 778.885875] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b03e07-779a-4752-ab34-78d602257f1f with Priority: HIGHEST for action port [ 778.886411] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.886646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.886755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.887076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.887250] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.888318] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.888514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.888819] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b03e07-779a-4752-ab34-78d602257f1f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.888984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.889090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.889402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.889611] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b03e07-779a-4752-ab34-78d602257f1f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.929949] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.393850] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b03e07-779a-4752-ab34-78d602257f1f with status ACTIVE [ 779.397085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.397085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.397085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.397085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.397085] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b03e07-779a-4752-ab34-78d602257f1f is going to be updated. [ 779.398692] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.400976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.418179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.418423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.418551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.419034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.419197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.420231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b03e07-779a-4752-ab34-78d602257f1f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.431780] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.739074] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 779.739313] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 779.739440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.739603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.739812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.740024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.740144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.740213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.740410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.740514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.740617] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.876109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 779.876472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.876736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.877084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.877482] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.933921] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.934251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.935240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.935240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.935240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.935240] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be updated. [ 779.966197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.966399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 779.966496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.967646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 779.967646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 779.985857] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 780.244826] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.347143] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 780.347482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.347577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.347785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.347876] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.374364] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 780.374364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.374364] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 780.374364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.374745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.375057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.375373] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.375749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.375957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.382876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.382876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.382876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.382876] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.384272] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.384380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.384440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.384595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.384749] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.384846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.384906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.385063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.385137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.385218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.385302] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.423683] env[62815]: INFO networking_nsxv3.common.synchronization [req-2d3aa8a2-7990-4ba6-8d12-2ac8e0782e16 req-7a5d6568-5c6d-43ff-a9d4-3b6ebe9e74c2 tempest-FloatingIPsAssociationTestJSON-821854022 tempest-FloatingIPsAssociationTestJSON-821854022-project-member] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 780.424291] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGHEST for action security_group_members [ 780.424603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.424734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.424803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.425020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.425448] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.425564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.425629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.425808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.425889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.425990] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.748343] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.832175] env[62815]: INFO networking_nsxv3.common.synchronization [req-f0e487f8-9864-40b9-b72c-76bb89877a75 req-d27f7206-1c22-4e9d-8420-1c58ebcf6359 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 780.832175] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 780.832175] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.832175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.832175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.832175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.832175] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.832175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.832175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.838761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.838761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.838761] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.855831] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.855831] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.855831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.855831] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.887233] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6d0cd-3c56-42cd-8d37-8158526e935b: rpc.has_security_group_logging(os_id): False [ 780.889868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.906048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.908179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.908179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.908179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.908612] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.908612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.908612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.908711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.908711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.909560] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 780.929024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.929163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.929232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.929435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.929521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.930081] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.930081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.930081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.930081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.930081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.930385] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be updated. [ 780.956060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.956060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.956060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.956060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.956060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.962785] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: IN_PROGRESS for 2s [ 780.966922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.967075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.967146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.967353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.967498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.979044] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 781.250109] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.250280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.250339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.250606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.250703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.250808] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 781.277278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.277436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.285825] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 781.341562] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.341720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.341788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.342021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.342117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.342320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.342421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.342481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.342633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.342727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.342818] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 781.361789] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.361789] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.361789] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.361789] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.361789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.362413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.362413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.362413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.362413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.362413] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.370508] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.370508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.370508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.370508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.370508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.376487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 781.394700] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for faad13ba-ac02-4335-855b-47b1737205ca: rpc.has_security_group_logging(os_id): False [ 781.405647] env[62815]: INFO networking_nsxv3.common.synchronization [req-8434be9b-c037-4bb8-a0dd-7aa3f1b80fa5 req-1e0ef502-d4c2-4fd6-b4c1-158dcba22c84 tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 781.406510] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 781.406806] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.406928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.406986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.408222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.408520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.408520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.408644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.408690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.408927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.408927] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.411761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.411867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.415074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.415074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.415074] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be updated. [ 781.471019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.471369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.471369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.471478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.471573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.487182] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: IN_PROGRESS for 2s [ 781.710291] env[62815]: INFO networking_nsxv3.common.synchronization [req-54548f0c-e196-43ce-85af-693f9f5aad54 req-c6466d77-d02f-4a89-94ce-09ee70e60d6f tempest-MultipleCreateTestJSON-1732776139 tempest-MultipleCreateTestJSON-1732776139-project-member] Enqueued Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 781.710886] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a93e2c7-70fc-4898-bef6-476829a0870e with Priority: HIGHEST for action security_group_members [ 781.711220] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a93e2c7-70fc-4898-bef6-476829a0870e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.711349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.862572] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a93e2c7-70fc-4898-bef6-476829a0870e: rpc.has_security_group_logging(os_id): False [ 781.882022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.882187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.882259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.882490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.882586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.882821] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.882913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.882976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.883138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.883214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.883387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.883481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.883532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.883667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.883749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.883960] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.884521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.884685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.884890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.888139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.888139] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 781.917549] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.943542] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.943675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.943716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.944115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.944115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.959620] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 781.994641] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 781.994858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.995384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.995678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.995926] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.996068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.996271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.996440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.996526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.996614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.996705] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.165280] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a32e086-3f47-46df-9985-7cde0d0cca8f req-db7fa30a-58bb-459a-b77a-f82da6a515ba tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 782.165825] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 782.166106] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.166235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.166304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.166500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.166653] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.166748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.166809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.166970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.167037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.167134] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.420592] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.483736] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.483736] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.484101] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.486598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.486598] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.486598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.486598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.486598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.486598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.486598] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.486598] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.486598] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.486598] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.486598] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.486598] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.486598] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.500275] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.500275] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.500275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.500682] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.500821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.501018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.501135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.501283] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.501413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.501569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.502024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.502024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.502024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.502024] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.505669] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.505866] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.506014] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.506190] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.506489] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-4599cb57-0e8d-476e-a225-cad5dd3a2049 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.506708] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.506840] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.507262] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.507262] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4599cb57-0e8d-476e-a225-cad5dd3a2049',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.670228] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.925163] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.925163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.925163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.925163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.925163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.925163] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 782.952119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.952293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.952362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.952597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.952770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.960334] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 782.969463] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3fac0c6-3de2-4540-bd01-063e50507e5a in Status: SUCCESS [ 782.969675] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a deletion is rescheduled due to dependency. [ 782.969759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.996715] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 782.996939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.997503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.997728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.997820] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.005230] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1a1399f-aaa7-4450-b8eb-595b8dff6f2f: rpc.has_security_group_logging(os_id): False [ 783.009163] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.009397] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.009528] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.009800] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.009947] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.010146] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 4599cb57-0e8d-476e-a225-cad5dd3a2049 not found, creating... [ 783.010464] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.010681] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.010830] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.011141] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.011322] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.011644] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.011861] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.012198] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.012480] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.012660] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.012823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 4599cb57-0e8d-476e-a225-cad5dd3a2049 is going to be created. [ 783.024019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.024019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.024188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.024268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.024367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.024597] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.024704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.024771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.024923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.025052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.025253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.025351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.025414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.025569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.025654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.025862] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.025961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.026050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.026196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.026272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.026367] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be updated. [ 783.033634] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.033832] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.033956] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.034224] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.034494] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.034654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.111784] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.111920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.112031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.112344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.112344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.129308] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 783.171955] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.297984] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 783.298277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.298546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.298870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.299172] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.299357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.299587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.299704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.299796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.299902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.300472] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.385975] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 783.386177] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 783.386283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.499764] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 783.500140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.500455] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.500616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.500661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.500865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.501084] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.501211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.501275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.501381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.501504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.501575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.501867] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.674355] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.674807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.674890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.675113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.675203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.675303] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 783.705754] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.705754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.705754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.705928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.706144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.716941] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 783.803186] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.803343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.803415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.803640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.803820] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.803935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.804006] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.804160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.804247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.804335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.804482] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.804572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.804632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.804779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.804909] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.804995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.805066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.805198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.805270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.805347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.805454] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.840249] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a32e086-3f47-46df-9985-7cde0d0cca8f req-3a757968-d5dc-4622-b2f2-d58c840ae603 service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 783.840459] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a32e086-3f47-46df-9985-7cde0d0cca8f req-3a757968-d5dc-4622-b2f2-d58c840ae603 service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 783.840607] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a32e086-3f47-46df-9985-7cde0d0cca8f req-3a757968-d5dc-4622-b2f2-d58c840ae603 service nova] Enqueued Resource ID: 4599cb57-0e8d-476e-a225-cad5dd3a2049 with Priority: HIGHEST for action port [ 783.840838] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 783.840963] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 783.843843] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4599cb57-0e8d-476e-a225-cad5dd3a2049 with Priority: HIGHEST for action port [ 783.845280] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.845409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.845480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.845681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.845764] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.846605] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.846708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.846892] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4599cb57-0e8d-476e-a225-cad5dd3a2049 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.846988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.847063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.847289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.847289] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4599cb57-0e8d-476e-a225-cad5dd3a2049',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.976867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 783.977206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.004174] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.004406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.004555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.004834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.005060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.005198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.005289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.005473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.006512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.006665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.006873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.007015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.007112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.007299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.008319] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.008319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.008319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.008319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.008319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.008319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.008826] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.311538] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6021d487-9de7-424f-8bb7-283b2180f7a7: rpc.has_security_group_logging(os_id): False [ 784.329292] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.329591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.329701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.329949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.330090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.330603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.330793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.330901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.331123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.331255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.331519] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.333091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.333091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.333091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.333091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.333091] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.333091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.333392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.333437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.333813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.334079] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 784.351254] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.351254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.351254] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4599cb57-0e8d-476e-a225-cad5dd3a2049 with status ACTIVE [ 784.351254] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.351254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.351254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.353941] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.353941] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.353941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.354425] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4599cb57-0e8d-476e-a225-cad5dd3a2049 is going to be updated. [ 784.375211] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.375211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.375211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.375211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.375211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.375211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4599cb57-0e8d-476e-a225-cad5dd3a2049" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.392649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.392649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.392649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.392649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.392649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.405125] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 784.514277] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6d0cd-3c56-42cd-8d37-8158526e935b: rpc.has_security_group_logging(os_id): False [ 784.547776] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.547776] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.547776] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.547776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.548476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.548476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.548476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.549666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.549940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.552629] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 784.621501] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.621831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.621910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.622150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.622370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.638439] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 784.919345] env[62815]: INFO networking_nsxv3.common.synchronization [None req-373423a6-e29c-40d8-ab00-4db0a950479f None None] Enqueued Resource ID: fcda9e6f-4215-4239-87d5-773a68ea345c with Priority: HIGHEST for action port [ 784.919345] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcda9e6f-4215-4239-87d5-773a68ea345c with Priority: HIGHEST for action port [ 784.919345] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcda9e6f-4215-4239-87d5-773a68ea345c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.919345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcda9e6f-4215-4239-87d5-773a68ea345c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.919345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcda9e6f-4215-4239-87d5-773a68ea345c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.919345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcda9e6f-4215-4239-87d5-773a68ea345c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.919345] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcda9e6f-4215-4239-87d5-773a68ea345c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.971314] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 784.971532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.971700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.971964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.972177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.972301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 784.972382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.972570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 784.972678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 784.972787] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a93e2c7-70fc-4898-bef6-476829a0870e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.144313] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 785.144535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.421287] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcda9e6f-4215-4239-87d5-773a68ea345c [ 785.421616] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.421771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.421835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.422062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.422154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.422243] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcda9e6f-4215-4239-87d5-773a68ea345c already deleted. [ 785.422323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcda9e6f-4215-4239-87d5-773a68ea345c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.482132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.482132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.482132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.482578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.482578] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e is going to be updated. [ 785.509567] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.509567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.509567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.509567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.509768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.517682] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: IN_PROGRESS for 2s [ 785.730269] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 785.730657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.730739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.730913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.731113] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.731238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.731288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.731439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.731519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.731621] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.236397] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.382151] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-cd567426-94e7-46ef-945f-18af0a4e96cd tempest-ListServersNegativeTestJSON-1738427851 tempest-ListServersNegativeTestJSON-1738427851-project-member] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 786.382151] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 786.382151] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.382151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.382151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.382151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.382151] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.382151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.382151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.383183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.383383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.383557] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.421186] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 786.421540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.653109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 786.653407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.740923] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.827100] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.828605] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.828605] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.833036] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.833036] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.833036] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.833036] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.833036] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.833036] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.833036] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.833036] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.833036] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.833036] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.833036] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.833036] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.833036] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.851097] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.851357] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.851632] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.851970] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.852501] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2758ec3c-1abf-4abd-a8bf-afc9b238656d taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.852802] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.853381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.853878] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.854482] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2758ec3c-1abf-4abd-a8bf-afc9b238656d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.885575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.885714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.885714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.885954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.886027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.886208] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.886917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.886917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.886917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.886917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.886917] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 already deleted. [ 786.886917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.156527] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f1247eb6-cc91-458a-b093-d0faa67b3970 None None] Enqueued Resource ID: 69c3785c-16b7-4ed7-9bb1-481db73abf41 with Priority: HIGHEST for action port [ 787.156804] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69c3785c-16b7-4ed7-9bb1-481db73abf41 with Priority: HIGHEST for action port [ 787.157403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-69c3785c-16b7-4ed7-9bb1-481db73abf41 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.157517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69c3785c-16b7-4ed7-9bb1-481db73abf41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.157592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69c3785c-16b7-4ed7-9bb1-481db73abf41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.157845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69c3785c-16b7-4ed7-9bb1-481db73abf41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.157929] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69c3785c-16b7-4ed7-9bb1-481db73abf41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.241618] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.241800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.241871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.242391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.242391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.242391] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 787.296418] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.296571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.296645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.296863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.297075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.306450] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 787.357401] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.358687] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.361926] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.362251] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.362409] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.362579] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2758ec3c-1abf-4abd-a8bf-afc9b238656d not found, creating... [ 787.362866] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.363101] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.363232] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.363494] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.363628] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.364966] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.364966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.364966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.364966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.364966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.364966] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2758ec3c-1abf-4abd-a8bf-afc9b238656d is going to be created. [ 787.388578] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.388578] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.388752] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.389038] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.389274] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.389494] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.527911] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a93e2c7-70fc-4898-bef6-476829a0870e in Status: SUCCESS [ 787.527911] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a93e2c7-70fc-4898-bef6-476829a0870e deletion is rescheduled due to dependency. [ 787.527911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a93e2c7-70fc-4898-bef6-476829a0870e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.661738] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69c3785c-16b7-4ed7-9bb1-481db73abf41 [ 787.662009] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.662206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.662301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.662543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.662661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.662780] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69c3785c-16b7-4ed7-9bb1-481db73abf41 already deleted. [ 787.662892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69c3785c-16b7-4ed7-9bb1-481db73abf41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.162136] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-15dc35f8-1a34-4734-8d41-1f8cb913b23a service nova] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_rules [ 788.162209] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-15dc35f8-1a34-4734-8d41-1f8cb913b23a service nova] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 788.162331] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-15dc35f8-1a34-4734-8d41-1f8cb913b23a service nova] Enqueued Resource ID: 2758ec3c-1abf-4abd-a8bf-afc9b238656d with Priority: HIGHEST for action port [ 788.162568] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_rules [ 788.162770] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 788.162868] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2758ec3c-1abf-4abd-a8bf-afc9b238656d with Priority: HIGHEST for action port [ 788.163854] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.163854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.163854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.163854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.163854] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.166423] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.166423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.166423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.166596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.166711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.166798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.166888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.168027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.168027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.168027] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.168027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2758ec3c-1abf-4abd-a8bf-afc9b238656d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.168261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.168261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.168334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.168716] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2758ec3c-1abf-4abd-a8bf-afc9b238656d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.671232] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.671603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.671603] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.672618] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2758ec3c-1abf-4abd-a8bf-afc9b238656d with status ACTIVE [ 788.672859] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.673024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.673068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.673408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.673469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.674303] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.674303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.674303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.674303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.675035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.675035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.675035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.675035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.675516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.676042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.678037] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2758ec3c-1abf-4abd-a8bf-afc9b238656d is going to be updated. [ 788.701559] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.701703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.701773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.701997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.702168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.702369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2758ec3c-1abf-4abd-a8bf-afc9b238656d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.040897] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-46688888-fdac-4018-9128-33c7277444af tempest-ListServersNegativeTestJSON-1738427851 tempest-ListServersNegativeTestJSON-1738427851-project-member] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 789.041451] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 789.041746] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.041848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.179664] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.315747] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 789.315961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.316147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.316359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.316544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.316660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.316724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.316873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.316952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.317047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.317136] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.667851] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.668074] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.668571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.668902] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.669359] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.669504] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.669632] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.670745] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.671028] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.671274] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.671510] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.671644] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.671766] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.671885] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.672026] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.672167] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.684040] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.684268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.684347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.684564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.684657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.684777] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be created. [ 789.692984] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.692984] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.692984] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.692984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.693178] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e845d3ab-a3ce-4faf-8f79-4367ab19802e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.693268] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.693327] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.693724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.693942] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e845d3ab-a3ce-4faf-8f79-4367ab19802e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.708221] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.708389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.708466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.708746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.708917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.717770] env[62815]: INFO networking_nsxv3.common.synchronization [req-eb243f5e-9240-4e84-a15b-a269fdbafb6f req-fe88c12e-5eb8-4ae7-adce-8a7d0d555563 tempest-ServersAdminNegativeTestJSON-39006248 tempest-ServersAdminNegativeTestJSON-39006248-project-member] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 789.718360] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 789.719623] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: UNINITIALIZED for 2s [ 789.719877] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.719998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.720096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.720291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.720723] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.720723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.720723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.720949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.720949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.720949] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.819550] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.819550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.819550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.819857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.819857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.819857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.820036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.820395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.820395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.820395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.820656] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.820656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.820656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.820820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.821086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.821086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 789.821384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.821384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 789.821384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.821566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 789.821566] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.197213] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.197533] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.197691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.197997] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.198173] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.198334] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e845d3ab-a3ce-4faf-8f79-4367ab19802e not found, creating... [ 790.198624] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.198787] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.198907] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.199153] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.199296] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.199681] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.199940] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.200283] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.200400] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.200588] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.200738] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e845d3ab-a3ce-4faf-8f79-4367ab19802e is going to be created. [ 790.222011] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.222336] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.222514] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.222988] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.223321] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.223607] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.224554] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.324150] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 790.342456] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.343161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.343161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.343161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.343337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.343553] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.343686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.343756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.343938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.344048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.344286] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.344477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.344524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.344659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.344762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.345031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.345139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.345253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.345425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.345567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.345709] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 790.424269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.424468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.424468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.425269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.425269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.444055] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 790.727894] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.978263] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-02ab4f84-fd5c-44de-8cb1-e5394d79e298 service nova] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_rules [ 790.978263] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-02ab4f84-fd5c-44de-8cb1-e5394d79e298 service nova] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 790.978263] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-02ab4f84-fd5c-44de-8cb1-e5394d79e298 service nova] Enqueued Resource ID: e845d3ab-a3ce-4faf-8f79-4367ab19802e with Priority: HIGHEST for action port [ 790.978263] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_rules [ 790.978263] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 790.978263] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e845d3ab-a3ce-4faf-8f79-4367ab19802e with Priority: HIGHEST for action port [ 790.978263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.978263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.978263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.978263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.978263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e845d3ab-a3ce-4faf-8f79-4367ab19802e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.978263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.978263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.978872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.978872] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e845d3ab-a3ce-4faf-8f79-4367ab19802e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.232023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.232402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.232613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.232804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.232964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.233162] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be updated. [ 791.259922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.260085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.260159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.260372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.260545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.268928] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 791.480799] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e845d3ab-a3ce-4faf-8f79-4367ab19802e with status ACTIVE [ 791.481128] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.481317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.481507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.481739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.481864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.482138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.482286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.482362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.482525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.482609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.483406] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.483406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.483406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.483406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.483406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.483406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e845d3ab-a3ce-4faf-8f79-4367ab19802e is going to be updated. [ 791.502403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.502600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.502600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.503109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.503109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.503109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e845d3ab-a3ce-4faf-8f79-4367ab19802e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.730791] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 791.731178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.731178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.731448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.731608] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.731713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.731773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.731951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.732042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.732137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.732224] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.733759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.734039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.734135] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.734239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.734315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.734422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.734521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.734603] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.235112] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.235331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.236540] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.461771] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 792.461771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.739648] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.068784] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-0cde12f3-97d0-45f7-9a23-0d5da0fbe871 tempest-ListServersNegativeTestJSON-1738427851 tempest-ListServersNegativeTestJSON-1738427851-project-member] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 793.068784] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 793.068784] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.068784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.242706] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.242868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.242925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.243228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.243378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.243378] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 793.273187] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.273308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.273397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.273616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.273808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.280088] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 793.280334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.285110] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 793.890645] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.890938] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.890979] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.891312] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.891604] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.891811] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.891987] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.892283] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.892480] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.892761] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.892874] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.893100] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.893262] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.893397] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.893552] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.893725] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.912315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.912530] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 793.912722] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.912886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-810" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.913324] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e25ec775-c1ac-4923-b088-b318ee979de3 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.913582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.913738] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.914127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.914318] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e25ec775-c1ac-4923-b088-b318ee979de3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.418912] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.419268] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.419359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.419683] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.419870] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.420577] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e25ec775-c1ac-4923-b088-b318ee979de3 not found, creating... [ 794.420577] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.420577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.420785] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.421080] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.421260] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.421599] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.421828] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.421983] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.422251] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.422413] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.422553] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e25ec775-c1ac-4923-b088-b318ee979de3 is going to be created. [ 794.441122] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.442495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.442495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.442495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.442495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.442495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.190809] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-dd6c57b5-f883-483f-85ad-1e4f792ee38c service nova] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_rules [ 795.191131] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-dd6c57b5-f883-483f-85ad-1e4f792ee38c service nova] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 795.191131] env[62815]: INFO networking_nsxv3.common.synchronization [req-d43d0591-2b8c-4430-8ac2-9f535787016b req-dd6c57b5-f883-483f-85ad-1e4f792ee38c service nova] Enqueued Resource ID: e25ec775-c1ac-4923-b088-b318ee979de3 with Priority: HIGHEST for action port [ 795.191367] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_rules [ 795.191493] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 795.191595] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e25ec775-c1ac-4923-b088-b318ee979de3 with Priority: HIGHEST for action port [ 795.192265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.192384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.192696] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.192745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.192894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e25ec775-c1ac-4923-b088-b318ee979de3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.193161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.193161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.193342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.193342] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e25ec775-c1ac-4923-b088-b318ee979de3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.296443] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 795.296706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.296913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.297204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.297481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.297669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.297802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.298035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.298155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.298292] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.695246] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e25ec775-c1ac-4923-b088-b318ee979de3 with status ACTIVE [ 795.695489] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.695652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.695725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.696195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.696195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.696405] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.696540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.696699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.696831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.697742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.697742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.697742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.697742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.697742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.697742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.697742] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e25ec775-c1ac-4923-b088-b318ee979de3 is going to be updated. [ 795.704864] env[62815]: INFO networking_nsxv3.common.synchronization [req-5eea96e3-879b-4355-b48a-ec73ea2e67a0 req-6a041ee3-0b11-4365-ad86-8ed4db17aa9a tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 795.705151] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 795.705737] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.705866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.705927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.706131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.706333] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.706581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.706664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.706817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.706898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.706987] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.720694] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.720847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.720932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.721202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.721364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.721582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e25ec775-c1ac-4923-b088-b318ee979de3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.801299] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.001860] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.002119] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.002291] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.002711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.002904] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.003129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.003286] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.003576] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.003740] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.003992] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.004154] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.004303] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.004424] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.004565] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.004690] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.004871] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.024110] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.024342] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.024499] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.024724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-847" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.025100] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2f5c1777-f89f-4211-bb95-d75782db59c6 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.025420] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.025462] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.025834] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.026032] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5c1777-f89f-4211-bb95-d75782db59c6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.211141] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.304771] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.389231] env[62815]: INFO networking_nsxv3.common.synchronization [req-896a1955-c26f-4b8e-9f99-7743d4787ab3 req-6b41b6bf-c270-4905-83be-28f26724e746 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 796.389502] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 796.390087] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.390428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.390663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.391041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.391483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.391774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.392050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.392389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.392622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.392856] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.528390] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.528657] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.528791] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.529086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.529255] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.529414] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2f5c1777-f89f-4211-bb95-d75782db59c6 not found, creating... [ 796.529693] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.529850] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.529969] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.530233] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.530411] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.530780] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.530961] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.531486] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.532074] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.532354] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.532567] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2f5c1777-f89f-4211-bb95-d75782db59c6 is going to be created. [ 796.551784] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.552016] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.552147] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.552428] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.552661] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.552886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.716459] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.807509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.807509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.807509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.807731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.807731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.807731] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 796.834263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.834489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.834617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.834852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.835048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.843406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 796.895383] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.225033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.225033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.225033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.225033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.225033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.225033] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 797.277136] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.277500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.277660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.277960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.278252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.292361] env[62815]: INFO networking_nsxv3.common.synchronization [req-5eea96e3-879b-4355-b48a-ec73ea2e67a0 req-5321096c-483f-42dc-9b47-dd970dc033c2 service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 797.292361] env[62815]: INFO networking_nsxv3.common.synchronization [req-5eea96e3-879b-4355-b48a-ec73ea2e67a0 req-5321096c-483f-42dc-9b47-dd970dc033c2 service nova] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 797.292361] env[62815]: INFO networking_nsxv3.common.synchronization [req-5eea96e3-879b-4355-b48a-ec73ea2e67a0 req-5321096c-483f-42dc-9b47-dd970dc033c2 service nova] Enqueued Resource ID: 2f5c1777-f89f-4211-bb95-d75782db59c6 with Priority: HIGHEST for action port [ 797.292361] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_rules [ 797.292361] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 797.292361] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5c1777-f89f-4211-bb95-d75782db59c6 with Priority: HIGHEST for action port [ 797.292361] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.292361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.292361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.293461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.293567] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.294859] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.294958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.295193] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f5c1777-f89f-4211-bb95-d75782db59c6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.295311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.295393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.295581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.295671] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f5c1777-f89f-4211-bb95-d75782db59c6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.299022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 797.397788] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.801592] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f5c1777-f89f-4211-bb95-d75782db59c6 with status ACTIVE [ 797.801592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.801592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.801592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.801592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.802333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.802333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.802333] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f5c1777-f89f-4211-bb95-d75782db59c6 is going to be updated. [ 797.804866] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.804866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.823635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.823785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.823847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.824086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.824209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.824412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f5c1777-f89f-4211-bb95-d75782db59c6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.900796] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.900941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.900941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.901202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.901306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.901414] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 797.946894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.947062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.947134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.947362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.947514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.960228] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 798.335121] env[62815]: INFO networking_nsxv3.common.synchronization [None req-79a8a6f4-9753-40fa-b5b4-6f2101086d4f tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_rules [ 798.335667] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_rules [ 798.336319] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.336445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.336506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.336780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.336864] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.428012] env[62815]: INFO networking_nsxv3.common.synchronization [None req-30d7e17b-df85-482e-96c2-42bc30137736 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_rules [ 798.428544] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_rules [ 798.428833] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.428931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.863568] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 798.863788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.863981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.864221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.864409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.864525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.864593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.864741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.864823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.864907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.865078] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.865161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.865223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.865364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.865501] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.865594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.865655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.865790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.865893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.866007] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.866129] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.867610] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.867721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.867789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.867941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.868030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.868116] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 already deleted. [ 798.868220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.868365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.868544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.868686] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.868779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.868842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.868979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.869067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.869155] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.869900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.870078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.870156] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.309153] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 799.309153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.309153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.309153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.309301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.309356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.309435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.309640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.309738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.309829] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.375440] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19461cde-6801-4c12-a058-618f670ad0d7: rpc.has_security_group_logging(os_id): False [ 799.376605] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.394103] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.394282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.394338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.394639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.394752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.394930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.411328] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.411328] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.411328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.411328] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be created. [ 799.411878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.411878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.411878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.411878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.411878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.411878] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 already deleted. [ 799.411878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.456108] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.456108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.456108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.456108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.456108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.466394] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 799.811703] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.880162] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.970513] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 799.971041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.314411] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.381897] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.382253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.382253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.382505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.382613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.382738] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 800.409026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.409026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.409193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.409304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.409430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.418678] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 800.816683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.816852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.816945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.817197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.817296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.817405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 800.851339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.851339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.851339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.851339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.851339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.859555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 801.427018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.427018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.427018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.427537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.427537] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.482813] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 801.483229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.483431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.483730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.483837] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.914171] env[62815]: INFO networking_nsxv3.common.synchronization [req-6ea1ec12-1820-4d3b-99ed-49d1f7e31c56 req-0589cc84-f998-4992-bd0b-2b22b8ea0682 tempest-ListServerFiltersTestJSON-1707760047 tempest-ListServerFiltersTestJSON-1707760047-project-member] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 801.914171] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 801.914171] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.914171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.914556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.914608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.915198] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.915198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 801.915198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.915198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 801.915198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 801.915198] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.930020] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.987128] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.987294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.419403] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.435493] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.437415] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 802.437619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.438298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.438510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.438692] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.438812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.438878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.439047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.439133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.439224] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.634138] env[62815]: INFO networking_nsxv3.common.synchronization [req-4bc90460-12c5-47d3-b642-db403cf81a4c req-c58ae26f-97c2-4576-b168-67d5101a958f tempest-ServersNegativeTestJSON-321560529 tempest-ServersNegativeTestJSON-321560529-project-member] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 802.634770] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 802.635199] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.635321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.635393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.635595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.635756] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.635854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.635910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.636070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.636236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.636236] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.868994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 802.869492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.869492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.869699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.873021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.873021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.873021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.873021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.873021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.873021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.873021] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.922740] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.938262] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 802.938812] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 802.942566] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.984875] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.985132] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.985132] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.985412] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.985733] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.985934] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.986078] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.986301] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.986441] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.986648] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.986836] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.986888] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.987011] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.987167] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.987248] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.987318] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.006546] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.006717] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.006864] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.007100] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.007422] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-7e18efe7-6f41-4c2d-b557-afcebd786b88 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.007957] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.007957] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.008107] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.008186] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e18efe7-6f41-4c2d-b557-afcebd786b88',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.137752] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.372699] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.372788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.372859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.373076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.373669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.373669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.373669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.373669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.373669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.373669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.374021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.374021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.374021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.374138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.374265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.374349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.374427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.374584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.374656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.374735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.374819] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.425564] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.425733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.425806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.426038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.426348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.426348] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 803.447176] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.473103] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.473291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.473438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.474834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.474991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.483933] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 803.510834] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.511084] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.511226] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.511650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.511899] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.512146] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 7e18efe7-6f41-4c2d-b557-afcebd786b88 not found, creating... [ 803.512558] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.512796] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.512963] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.513296] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.513460] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.513837] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.514015] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.514164] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.514366] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.514502] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.514642] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 7e18efe7-6f41-4c2d-b557-afcebd786b88 is going to be created. [ 803.538238] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.538238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.538238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.538238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.538238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.538238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.640985] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.816549] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.816728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.816784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.816995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.831631] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 803.832442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.833867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 803.859203] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.859387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.859442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.859661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.866803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.867267] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 803.867346] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 803.867514] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 803.877222] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50851b2f-e9ba-4c66-9351-f1d66386b1c2: rpc.has_security_group_logging(os_id): False [ 803.892721] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.892912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.892978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.893158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.893246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.893430] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.893526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.893587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.893729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.893801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.893981] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.894101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.894179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.894328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.894402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.894598] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.894690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.894755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.894923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.894999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.895101] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 803.904070] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.904246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.904246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.905031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.905692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.905854] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 803.950016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.950356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.950438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.950733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.950831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.950929] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 804.008742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.008960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.009058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.009311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.009483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.019749] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 804.030817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.030952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.031066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.031325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.031589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.044606] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.044767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.044839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.045015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.045250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.045491] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 804.046938] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 804.127185] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.127390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.127456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.127634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.127869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.128197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 804.128266] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'19461cde-6801-4c12-a058-618f670ad0d7', '9a360f68-c409-4d28-9396-e41a05128638', 'a3fac0c6-3de2-4540-bd01-063e50507e5a', '6ba85b5f-4e58-41b0-b69c-fab3d71be927', '6d9dce03-d37e-4edb-85ab-d71157c4485b', '9570a2bb-1432-4892-8f5f-0ca9a33988d0', '73cab825-2378-45d6-b89b-7d11138b2d06', 'cd01ddbc-d1e1-4701-8791-8347e2ae4ba7', 'bc1a7e1c-300f-43dc-b3c7-fe7528e023f3', '13765b88-768f-4b1f-9fb5-8542df45be52', '1d6bbb76-6d82-445e-a124-2538b600ecb4', 'b341d199-0570-4483-a66b-c412fafde85f', 'a1a1399f-aaa7-4450-b8eb-595b8dff6f2f', 'b036f05a-9535-4198-b6ab-eff3bdc28054', '2474a688-4edd-47c2-8e2f-90218dd98e8a', 'a03c29c0-c680-419e-9d7c-4307d6fd5fd7', '686574a8-1080-450a-a759-40ce406709a1', '9aee6bbb-a299-4192-aa7a-87a17036d3e8', 'c35758e4-45cb-490c-89ec-fb2fd51be5f9', 'a2c257cd-88aa-41f2-80e5-a79e264a317d', 'd4eb0fce-410c-49a9-858d-6d903b2d7c99', '7db29840-7ccf-49ac-af49-fd6b13cfbba7', '6c580d0c-d242-4267-94c1-b84435b0f93c', 'e2f3140d-d06d-40e7-9719-ba1446ff3270', 'faad13ba-ac02-4335-855b-47b1737205ca', '6021d487-9de7-424f-8bb7-283b2180f7a7', 'df11bad1-7d19-47ba-9b6a-8f12d59d5612', '21b0e5c1-1fe6-480e-963c-67f29a11cd78', '64b65322-480c-4891-a478-1d5f60cffcc2', '6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d', '0a93e2c7-70fc-4898-bef6-476829a0870e', 'e2840bf9-b592-4644-bcf1-bd4ca72a79e5', 'b4d6d0cd-3c56-42cd-8d37-8158526e935b', 'efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a', '50851b2f-e9ba-4c66-9351-f1d66386b1c2', 'bdd0df41-58d9-475d-b389-1f971293a516', '95315c29-36f4-4fb3-afae-f96b062c5650'} {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 804.128347] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 804.143171] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.143340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.143404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.143568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.143677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.143740] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 804.146407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.146553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.146649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.146781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.146849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.146985] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 804.147093] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 804.147093] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 804.169362] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.169504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.169574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.170116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.170242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.180370] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 804.220324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.220595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.220713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.220996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.222349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.224604] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 804.224739] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 804.224854] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 804.224970] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 804.225123] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 804.225243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGH for action security_group_rules [ 804.225372] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGH for action security_group_rules [ 804.225487] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGH for action security_group_rules [ 804.225603] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGH for action security_group_rules [ 804.225753] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGH for action security_group_rules [ 804.225865] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGH for action security_group_rules [ 804.225950] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGH for action security_group_rules [ 804.226097] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGH for action security_group_rules [ 804.226212] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGH for action security_group_rules [ 804.226330] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGH for action security_group_rules [ 804.226467] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGH for action security_group_rules [ 804.226551] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGH for action security_group_rules [ 804.226662] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGH for action security_group_rules [ 804.226774] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGH for action security_group_rules [ 804.226887] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGH for action security_group_rules [ 804.227000] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGH for action security_group_rules [ 804.227135] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGH for action security_group_rules [ 804.227289] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGH for action security_group_rules [ 804.227372] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGH for action security_group_rules [ 804.227515] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGH for action security_group_rules [ 804.227645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.276531] env[62815]: INFO networking_nsxv3.common.synchronization [req-4bc90460-12c5-47d3-b642-db403cf81a4c req-24420d31-6327-42de-9681-b256397e31cb service nova] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_rules [ 804.276700] env[62815]: INFO networking_nsxv3.common.synchronization [req-4bc90460-12c5-47d3-b642-db403cf81a4c req-24420d31-6327-42de-9681-b256397e31cb service nova] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 804.276900] env[62815]: INFO networking_nsxv3.common.synchronization [req-4bc90460-12c5-47d3-b642-db403cf81a4c req-24420d31-6327-42de-9681-b256397e31cb service nova] Enqueued Resource ID: 7e18efe7-6f41-4c2d-b557-afcebd786b88 with Priority: HIGHEST for action port [ 804.277156] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_rules [ 804.277387] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 804.277438] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e18efe7-6f41-4c2d-b557-afcebd786b88 with Priority: HIGHEST for action port [ 804.277505] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGH for action security_group_rules [ 804.277603] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3fac0c6-3de2-4540-bd01-063e50507e5a with Priority: HIGH for action security_group_rules [ 804.277713] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cab825-2378-45d6-b89b-7d11138b2d06 with Priority: HIGH for action security_group_rules [ 804.277785] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a with Priority: HIGH for action security_group_rules [ 804.277875] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2c257cd-88aa-41f2-80e5-a79e264a317d with Priority: HIGH for action security_group_rules [ 804.278232] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 with Priority: HIGH for action security_group_rules [ 804.278366] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 with Priority: HIGH for action security_group_rules [ 804.278461] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGH for action security_group_rules [ 804.278552] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGH for action security_group_rules [ 804.278656] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGH for action security_group_rules [ 804.278723] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGH for action security_group_rules [ 804.278806] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGH for action security_group_rules [ 804.279587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGH for action security_group_rules [ 804.279587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13765b88-768f-4b1f-9fb5-8542df45be52 with Priority: HIGH for action security_group_rules [ 804.279587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 with Priority: HIGH for action security_group_rules [ 804.279587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 with Priority: HIGH for action security_group_rules [ 804.279587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGH for action security_group_rules [ 804.279587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGH for action security_group_rules [ 804.280258] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGH for action security_group_rules [ 804.280391] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGH for action security_group_rules [ 804.282419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.282560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.282624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.282942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.283060] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.283978] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.284096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.284299] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e18efe7-6f41-4c2d-b557-afcebd786b88 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.284404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.284464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.284635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.284710] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e18efe7-6f41-4c2d-b557-afcebd786b88',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.285624] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.285723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.285913] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3fac0c6-3de2-4540-bd01-063e50507e5a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.286052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.286093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.286220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.286283] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3fac0c6-3de2-4540-bd01-063e50507e5a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.287075] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73cab825-2378-45d6-b89b-7d11138b2d06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.287314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.287440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.287630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.287745] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73cab825-2378-45d6-b89b-7d11138b2d06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.288963] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2474a688-4edd-47c2-8e2f-90218dd98e8a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.289070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.289156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.289290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.289443] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2474a688-4edd-47c2-8e2f-90218dd98e8a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.290369] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2c257cd-88aa-41f2-80e5-a79e264a317d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.290495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.290647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.290825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.290900] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2c257cd-88aa-41f2-80e5-a79e264a317d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.291750] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.291875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.291954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.292123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.292199] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35758e4-45cb-490c-89ec-fb2fd51be5f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.293157] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.293303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.293384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.293468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.293530] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aee6bbb-a299-4192-aa7a-87a17036d3e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.294384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.294485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.294656] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.294751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.294806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.294996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.295077] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.295881] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.295984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.296092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.296220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.296323] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.297117] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.297587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.297587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.297587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.297723] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.297845] env[62815]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 804.298581] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.298708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.298763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.298899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.299033] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.299762] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.299863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.299929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.300088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.300158] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.300981] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13765b88-768f-4b1f-9fb5-8542df45be52 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.301124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.301196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.301295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.301365] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13765b88-768f-4b1f-9fb5-8542df45be52',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.302257] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.302369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.302435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.302563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.302636] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1a7e1c-300f-43dc-b3c7-fe7528e023f3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.303451] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.303567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.303636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.303759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.303833] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9570a2bb-1432-4892-8f5f-0ca9a33988d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.304622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.304749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.304867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.304957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.305066] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.305873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.305975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.306044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.306183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.306254] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.307044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.307152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.307217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.307362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.307432] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.308216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.308320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.308387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.308572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.308653] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.473502] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.473502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.495028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.495028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.495028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.495028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.518162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.518296] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3fac0c6-3de2-4540-bd01-063e50507e5a is going to be deleted. [ 804.578368] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.578568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.578660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.578881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.578979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.579131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3fac0c6-3de2-4540-bd01-063e50507e5a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.814032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e18efe7-6f41-4c2d-b557-afcebd786b88 with status ACTIVE [ 804.814032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.814032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.814032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.814299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.814299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.814454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.814559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.814606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.814751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.814826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.815018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.815128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.815180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.815319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.815390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.815487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e18efe7-6f41-4c2d-b557-afcebd786b88 is going to be updated. [ 804.836066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.836066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.836066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.836066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.836066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.836066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e18efe7-6f41-4c2d-b557-afcebd786b88" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.006119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.006285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.006389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.006589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.006762] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.006863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.006928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.007092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.007191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.007260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.007357] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.008342] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.008469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.008559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.008741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.008892] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.008984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.010460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.010739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.010839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.011079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.011079] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.013658] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.013946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.013946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.014048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.014151] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.014244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.014306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.014450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.014531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.014613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.014696] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.015479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.015587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.015656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.015807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.015941] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.016108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.016108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.016240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.016321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.016396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.016476] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.018882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.018962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.022024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.022174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.022254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.022434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.022604] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.022730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.022798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.022961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.023053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.023138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.023218] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.025563] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.025683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.026022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.026127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.026519] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.026519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.026519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.026696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.026696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.026696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.026803] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.031851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.031851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.031996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.032064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.032214] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.032306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.032366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.032507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.032581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.032658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.032757] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.039930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.040072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.040121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.040288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.040690] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.040690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.040690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.040855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.040855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.040923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.041064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.041157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.041217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.041352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.041594] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.041594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.041724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.041837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.041913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.041994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.042091] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.047626] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.049712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b036f05a-9535-4198-b6ab-eff3bdc28054: rpc.has_security_group_logging(os_id): False [ 805.071604] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.071769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.071855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.072061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.074013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.074133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.074782] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.075087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.076020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.076020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.077093] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.077244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.078230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.078230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.082866] env[62815]: INFO networking_nsxv3.common.synchronization [req-ce6277f1-e0c8-4271-9cf3-81c8da31bfbe req-499187c5-1f70-48f3-93fc-fff8b0775044 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 805.083406] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 805.084265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.084384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.084638] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.084754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.084839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.085212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.085377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.085495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.085579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.085701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.085796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.085938] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.090048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.090048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.090048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.090048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.090048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.090048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.090548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.090548] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9570a2bb-1432-4892-8f5f-0ca9a33988d0 is going to be deleted. [ 805.091378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.091536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.106887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.106996] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73cab825-2378-45d6-b89b-7d11138b2d06 is going to be deleted. [ 805.108201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.108391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.125054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.125054] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be deleted. [ 805.125196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.125400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.143513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.143697] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1a7e1c-300f-43dc-b3c7-fe7528e023f3 is going to be deleted. [ 805.144622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.144869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.146305] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.146450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.153627] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.153786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.167079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.167222] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35758e4-45cb-490c-89ec-fb2fd51be5f9 is going to be deleted. [ 805.169691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.169691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.171521] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.171657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.193299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.193483] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2c257cd-88aa-41f2-80e5-a79e264a317d is going to be deleted. [ 805.194335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.194552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.199980] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.200124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.213963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.214105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13765b88-768f-4b1f-9fb5-8542df45be52 is going to be deleted. [ 805.214965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.215173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.231515] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.231652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.244756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.245045] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.245172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.245240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.245438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.245519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.245722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.245817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.245879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.246031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.246107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.246289] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.246366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.246426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.246666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.246744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.246835] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be updated. [ 805.247863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.248034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.290139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.290278] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aee6bbb-a299-4192-aa7a-87a17036d3e8 is going to be deleted. [ 805.291297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.291506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.291695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.291828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9570a2bb-1432-4892-8f5f-0ca9a33988d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.291986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.292159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.292236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.292492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73cab825-2378-45d6-b89b-7d11138b2d06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.293027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.293177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.293260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.293442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.293501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.293649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.293726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.293838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1a7e1c-300f-43dc-b3c7-fe7528e023f3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.293965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.294118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.294196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.294408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35758e4-45cb-490c-89ec-fb2fd51be5f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.294546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.294688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.329834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.329997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.330927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.331079] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2474a688-4edd-47c2-8e2f-90218dd98e8a is going to be deleted. [ 805.331959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.332175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.332263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.332382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2c257cd-88aa-41f2-80e5-a79e264a317d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.333068] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.333199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.333255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.333406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.333485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.333594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13765b88-768f-4b1f-9fb5-8542df45be52" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.439967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.440255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.440255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.440403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.440598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.442278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.442340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.442431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.442558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.442646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.442755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aee6bbb-a299-4192-aa7a-87a17036d3e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.446769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.446906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.446978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.447107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.447190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.447298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2474a688-4edd-47c2-8e2f-90218dd98e8a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.463581] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 805.510524] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 805.510842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.511024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.511251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.511447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.511575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.511644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.511829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.511924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.512024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.512121] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.513921] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.517745] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.518101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.518301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.518301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.518533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.518684] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.518784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.518847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.518979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.519300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.519300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.519300] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.519493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.519493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.519587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.519753] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.519815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.519912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.519996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.520098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.520172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.520246] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.538632] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.546319] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.552872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a360f68-c409-4d28-9396-e41a05128638: rpc.has_security_group_logging(os_id): False [ 805.585137] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.585280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.585348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.585563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.590109] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.590230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.613074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.613377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.613496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.613552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.613742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.613825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.613912] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be updated. [ 805.614953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.615668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.642287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.642590] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.642722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.642788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.643116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.643274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.643448] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 805.667241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.667373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.667469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.667643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.667783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.679310] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 805.685520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.685520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.685754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.685754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.686035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.689208] env[62815]: INFO networking_nsxv3.common.synchronization [req-9127a6b8-1808-4446-acbc-e08e3d205aa5 req-e33f7dc0-fe13-4b12-a523-7357185fc3d2 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 805.689943] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 805.689943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.690445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.690445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.690445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.691271] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.691271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.691271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.691271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.691271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.691271] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.700921] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 806.015398] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.015398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.015398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.015398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.015621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.015621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.015621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.015743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.016145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.016145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.016842] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.017020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.017099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.017242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.017395] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.017488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.017544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.021018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.021018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.021018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.021018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.022751] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ba85b5f-4e58-41b0-b69c-fab3d71be927: rpc.has_security_group_logging(os_id): False [ 806.026796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd01ddbc-d1e1-4701-8791-8347e2ae4ba7: rpc.has_security_group_logging(os_id): False [ 806.026796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1a1399f-aaa7-4450-b8eb-595b8dff6f2f: rpc.has_security_group_logging(os_id): False [ 806.036234] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 806.036446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.036912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.037128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.037308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.037422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.037480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.037719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.037719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.037816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.037888] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.041863] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d9dce03-d37e-4edb-85ab-d71157c4485b: rpc.has_security_group_logging(os_id): False [ 806.043697] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.043827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.043892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.044087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.047775] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.047937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.048581] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.048684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.051336] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a03c29c0-c680-419e-9d7c-4307d6fd5fd7: rpc.has_security_group_logging(os_id): False [ 806.059171] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.059373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.066060] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 806.066277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.067139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.067462] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.067570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.067639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.067828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.067908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.068007] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 806.070168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.070349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.071864] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.072028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.103756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.104166] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.104166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.104370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.104421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.104486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.104669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.104772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.104827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.105079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.105079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.105236] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.105310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.105369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.105507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.105625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.105679] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be updated. [ 806.106702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.106866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.126947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.127307] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.127675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.127675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.127812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.127886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.127941] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b is going to be updated. [ 806.132265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.132265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.139892] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.140104] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.140235] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.140544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.140840] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.141019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.141156] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.141374] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.141525] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.141759] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.141880] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.141996] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.142125] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.142239] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.142349] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.142484] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.158615] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.158844] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.158989] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.159184] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.159491] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-9c9d83d2-1dd8-438b-838b-cd71410ed744 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.159667] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.159793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.160123] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.160269] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9d83d2-1dd8-438b-838b-cd71410ed744',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.162038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.162288] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.162381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.162437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.162600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.162681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.162774] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 is going to be updated. [ 806.163885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.164060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.165548] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.165648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.177536] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.177679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.192854] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.193038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.212527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.212805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.212902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.212969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.213180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.213263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.213359] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 is going to be updated. [ 806.214374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.214538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.214676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.215667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.215726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.215835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.217531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.217531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.217531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.217531] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.217531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.217531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.217819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.217819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.217819] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 already deleted. [ 806.217923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.219036] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 806.219213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.219876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.220050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.220206] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.220311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.220374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.220892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.220892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.220892] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.222832] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.222958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.223037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.223189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.223309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.272739] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 806.273498] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 806.274092] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: IN_PROGRESS for 2s [ 806.370042] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.370042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.370042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.370042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.370042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.384443] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.384443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.384443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.384443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.384443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.389025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: IN_PROGRESS for 2s [ 806.399496] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: IN_PROGRESS for 2s [ 806.527267] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b341d199-0570-4483-a66b-c412fafde85f: rpc.has_security_group_logging(os_id): False [ 806.542864] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.543080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.543080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.543279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.543461] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.543617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.543617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.543782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.543876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.543956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.544119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.544213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.544271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.544411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.544544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.544633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.544692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.544825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.544900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.544980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.545305] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.547470] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.547605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.547668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.547871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.566698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.567010] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.567169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.567260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.567449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.567534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.567755] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.567880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.567972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.568164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.568245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.568443] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.568542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.568595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.568743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.568843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.568933] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 806.625024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.625206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.625280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.625527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.625688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.639647] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 806.665992] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.665992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.665992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.665992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.665992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.665992] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 9c9d83d2-1dd8-438b-838b-cd71410ed744 not found, creating... [ 806.666456] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.666456] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.666582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.666737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.666886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.667200] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.667361] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.667483] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.667710] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.667902] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.668179] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 9c9d83d2-1dd8-438b-838b-cd71410ed744 is going to be created. [ 806.706726] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.706726] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.706726] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.706978] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.707108] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.707362] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.723095] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.049605] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19461cde-6801-4c12-a058-618f670ad0d7: rpc.has_security_group_logging(os_id): False [ 807.067160] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.067319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.067402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.067586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.083980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.084256] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.084380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.084451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.084668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.084758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.084924] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.085092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.085092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.085230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.085298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.085479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.085574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.085640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.085768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.085827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.085915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 807.142427] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.142723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.142723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.142931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.142999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.154264] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 807.228899] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.479875] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 807.480216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.532415] env[62815]: INFO networking_nsxv3.common.synchronization [req-9127a6b8-1808-4446-acbc-e08e3d205aa5 req-5f4f223e-0148-45a9-ac28-b3f803c2ce3c service nova] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 807.532677] env[62815]: INFO networking_nsxv3.common.synchronization [req-9127a6b8-1808-4446-acbc-e08e3d205aa5 req-5f4f223e-0148-45a9-ac28-b3f803c2ce3c service nova] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 807.532769] env[62815]: INFO networking_nsxv3.common.synchronization [req-9127a6b8-1808-4446-acbc-e08e3d205aa5 req-5f4f223e-0148-45a9-ac28-b3f803c2ce3c service nova] Enqueued Resource ID: 9c9d83d2-1dd8-438b-838b-cd71410ed744 with Priority: HIGHEST for action port [ 807.534651] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 807.534865] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 807.534929] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c9d83d2-1dd8-438b-838b-cd71410ed744 with Priority: HIGHEST for action port [ 807.536647] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.536647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.536647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.536647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.536647] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.537485] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.537485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.537485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.537682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.537682] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.537771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.537806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.537947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.538065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.538686] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.539869] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c9d83d2-1dd8-438b-838b-cd71410ed744 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.539869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.539869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.539869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.539869] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9d83d2-1dd8-438b-838b-cd71410ed744',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.689296] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 807.689515] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 807.689587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.712921] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 807.713168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.732049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.732049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.732235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.732746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.732746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.732746] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 807.756734] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 412 Client Error: Precondition Failed for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/groups/686574a8-1080-450a-a759-40ce406709a1 [ 807.756875] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 807.822670] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.822821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.822897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.823166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.824028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.824213] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.824327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.824438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.824543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.824621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.824711] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 807.854292] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.855884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.855884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.855884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.855884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.863639] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 808.015818] env[62815]: INFO networking_nsxv3.common.synchronization [req-08388324-b4d2-43c6-96af-e1d7cc5c991e req-27d3b238-5b2e-404c-b5c1-7c7d04fb5dea tempest-ListServersNegativeTestJSON-1738427851 tempest-ListServersNegativeTestJSON-1738427851-project-member] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 808.017264] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 808.017604] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.017729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.017797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.017994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.018154] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.018252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.018314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.018546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.018740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.018840] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.043738] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.043738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.043738] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.043972] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c9d83d2-1dd8-438b-838b-cd71410ed744 with status ACTIVE [ 808.044197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.044282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.044343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.044519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.044608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.044774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.044863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.044921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.045246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.045378] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.045940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.045940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.045940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.045940] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c9d83d2-1dd8-438b-838b-cd71410ed744 is going to be updated. [ 808.071184] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.071317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.071381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.072844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.072844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.072844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c9d83d2-1dd8-438b-838b-cd71410ed744" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.335510] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 808.335695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.336424] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: SUCCESS [ 808.336596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.337362] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 808.337536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.406835] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: SUCCESS [ 808.407071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.409840] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: SUCCESS [ 808.409960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.522024] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.549109] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.656266] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 808.656505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.023424] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.050969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.051189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.051189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.051689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.051689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.051689] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be created. [ 809.074587] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.074747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.074796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.075282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.075282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.084450] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: UNINITIALIZED for 2s [ 809.166854] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 809.166854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.167091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.167313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.167423] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.526110] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.526277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.526352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.526569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.526679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.526805] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 809.563049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.563049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.563049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.563533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.563599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.574974] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 809.669701] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.669846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.872814] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 809.873139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.873139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.873512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.873793] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.873946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 809.874071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.874311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 809.874432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.874548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 809.874697] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.376732] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.376893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.376961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.377209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.377377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.377477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.377530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.377677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.377762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.377849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.377994] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.378098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.378149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.378280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.378412] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.378499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.378559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.378688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.378763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.378842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.378926] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.883365] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 686574a8-1080-450a-a759-40ce406709a1: rpc.has_security_group_logging(os_id): False [ 810.910018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.910018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.910018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.910018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.928791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.929236] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.929538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.929713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.929983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.930182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.930454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.930677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.930830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.931084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.931247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.931504] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.931856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.932157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.932322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.932496] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 810.989557] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.989557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.989557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.989557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.990071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.007394] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 811.097033] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 811.098050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.098050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.098050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.098050] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.098050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.098050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.098387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.098387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.098387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.098387] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.586863] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 811.587099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.587412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.587527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.587694] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.587808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.587879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.588021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.588095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.588209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.588268] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.600924] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.090726] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.091217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.091217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.091341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.091516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.091645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.091716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.091956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.092104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.092297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.092386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.092569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.092569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.092693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.092864] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.092993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.093067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.093224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.093330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.093418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.093531] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.103731] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4881bfba-b46e-4d29-a2f7-9a11e08570b3: rpc.has_security_group_logging(os_id): False [ 812.122935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.123187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.123187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.123488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.123640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.123998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.124178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.124285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.124531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.124659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.124800] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be created. [ 812.192450] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.192450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.192450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.193161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.193302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.220784] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: IN_PROGRESS for 2s [ 812.596912] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19461cde-6801-4c12-a058-618f670ad0d7: rpc.has_security_group_logging(os_id): False [ 812.614014] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.614523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.614587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.615214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.615214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.615214] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.615214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.615415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.615447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.615520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.615727] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.615821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.615881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.616043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.616212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.616304] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.616396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.616457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.616612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.616683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.616765] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 812.671987] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.672152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 812.672226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.672445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 812.672591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 812.688950] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 813.018228] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 813.018378] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 813.022489] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 813.022703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.022880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.023111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.023204] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.527835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.527835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.527835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.527835] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.843648] env[62815]: INFO networking_nsxv3.common.synchronization [None req-fe312b48-9cc9-4b90-bc9d-d22ce03c3a8b None None] Enqueued Resource ID: 66aa79a4-5e05-4545-9bd0-927cdebbfef2 with Priority: HIGHEST for action port [ 813.844974] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66aa79a4-5e05-4545-9bd0-927cdebbfef2 with Priority: HIGHEST for action port [ 813.845509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-66aa79a4-5e05-4545-9bd0-927cdebbfef2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.845757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66aa79a4-5e05-4545-9bd0-927cdebbfef2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.846168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66aa79a4-5e05-4545-9bd0-927cdebbfef2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.846626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66aa79a4-5e05-4545-9bd0-927cdebbfef2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.846811] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66aa79a4-5e05-4545-9bd0-927cdebbfef2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.066349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.066349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.066349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.066349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.066349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.067089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.067089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.067089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.067089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.067089] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.235588] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 814.236030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.350487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66aa79a4-5e05-4545-9bd0-927cdebbfef2 [ 814.350487] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.350487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.350487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.350487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.350487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.350487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66aa79a4-5e05-4545-9bd0-927cdebbfef2 already deleted. [ 814.350487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66aa79a4-5e05-4545-9bd0-927cdebbfef2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.537720] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 686574a8-1080-450a-a759-40ce406709a1: rpc.has_security_group_logging(os_id): False [ 814.553210] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.553376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.553446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.553678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.553773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.553997] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.554118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.554178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.554323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.554400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.554573] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.554670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.554748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.554900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.555015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.555162] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.555248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.557347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.557347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.557347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.557347] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 814.613371] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.613486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.613486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.614374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.614374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.626685] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 814.720054] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 814.720191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.720388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.720544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.720688] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.227732] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.227732] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.227732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.227732] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.329617] env[62815]: INFO networking_nsxv3.common.synchronization [req-a46d28ba-403f-40d3-be68-74bbe6d1f220 req-5fba291e-a1a0-40f4-aca9-5bb7de22805f tempest-ServersNegativeTestJSON-321560529 tempest-ServersNegativeTestJSON-321560529-project-member] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 815.330428] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 815.330428] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.330428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.330428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.330694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.330694] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.330768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.330768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.331129] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.331129] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.332285] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.730272] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.730551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.730551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.730793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.730978] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.731115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.731182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.731384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.731478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.731571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.731728] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.731832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.731880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.732046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.732220] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.732318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 815.732378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.732528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 815.732793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.732793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 815.732793] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.837658] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.236092] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19461cde-6801-4c12-a058-618f670ad0d7: rpc.has_security_group_logging(os_id): False [ 816.254586] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.254864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.254974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.255247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.255375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.255598] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.255728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.255818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.256010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.256120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.256349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.256476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.256559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.256734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.256836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.257950] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.257950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.257950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.257950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.257950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.257950] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 816.265829] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c3cc30f4-6c35-4b79-8349-41a85ed5be36 None None] Enqueued Resource ID: 1ac8e0db-791d-4907-9ab6-5b4bea2ee10d with Priority: HIGHEST for action port [ 816.265829] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac8e0db-791d-4907-9ab6-5b4bea2ee10d with Priority: HIGHEST for action port [ 816.265829] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ac8e0db-791d-4907-9ab6-5b4bea2ee10d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.265934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ac8e0db-791d-4907-9ab6-5b4bea2ee10d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.265934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ac8e0db-791d-4907-9ab6-5b4bea2ee10d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.266737] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ac8e0db-791d-4907-9ab6-5b4bea2ee10d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.266737] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ac8e0db-791d-4907-9ab6-5b4bea2ee10d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.329026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.329026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.329026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.329202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.329202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.340705] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.345435] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 816.643411] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 816.643724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.771387] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ac8e0db-791d-4907-9ab6-5b4bea2ee10d [ 816.771689] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.773084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.773084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.773084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.773084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.773084] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ac8e0db-791d-4907-9ab6-5b4bea2ee10d already deleted. [ 816.773084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ac8e0db-791d-4907-9ab6-5b4bea2ee10d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.843374] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.843533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.846090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.846090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.846090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.846090] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 816.872030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.872030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.872030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.872030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.872030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.878611] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 817.872023] env[62815]: INFO networking_nsxv3.common.synchronization [req-a6373bf9-5c8f-48f5-bcfa-5bcee8801730 req-8b722941-c807-49d1-89f1-3021039ed742 tempest-MigrationsAdminTest-121633230 tempest-MigrationsAdminTest-121633230-project-member] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 817.872023] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 817.872987] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.872987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.872987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.872987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.873211] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.873268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.873298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.873469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.873565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.873668] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.362196] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 818.362449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.376244] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.878776] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.889447] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 818.889447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.382077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.382245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.382317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.382532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.382622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.382725] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be updated. [ 819.414139] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.414286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.414359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.414564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.415039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.423409] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 821.434090] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 821.434334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.543538] env[62815]: INFO networking_nsxv3.common.synchronization [req-852d8357-f7a2-4640-b98d-f17d251f2d31 req-5610a07e-5ff6-44a2-a731-a80770450d54 tempest-ServerPasswordTestJSON-762240649 tempest-ServerPasswordTestJSON-762240649-project-member] Enqueued Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_members [ 821.544189] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_members [ 821.544506] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.544958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.545080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.545369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.546069] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.547082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.547082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.547082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.547082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.547082] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.863939] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-688 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.865233] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.865233] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.865723] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.866033] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.866210] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.866329] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.866606] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.866712] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.866943] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.867049] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.867218] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.867281] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.867378] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.867492] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.867626] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.886996] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.886996] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.887195] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.887420] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-688" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.887760] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.887959] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.888150] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.888504] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.888700] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f825989b-8c11-47bc-b0a8-c3d0fb82fc27',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.048885] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.050449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.050449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.050449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.050449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.050449] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.050449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.050449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.050661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.050702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.050783] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71609a59-7de6-462b-b6e5-244b95f4175c already deleted. [ 822.050865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.391462] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.391692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.391875] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.392189] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.392350] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.392511] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port f825989b-8c11-47bc-b0a8-c3d0fb82fc27 not found, creating... [ 822.392805] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.392992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.393177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.393417] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.393564] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.393854] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.394149] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394354] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.394491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.394633] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: f825989b-8c11-47bc-b0a8-c3d0fb82fc27 is going to be created. [ 822.434906] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.435373] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.435373] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.435517] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.435743] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.435974] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.098714] env[62815]: INFO networking_nsxv3.common.synchronization [req-852d8357-f7a2-4640-b98d-f17d251f2d31 req-de9fb2a7-784c-4781-a50a-85ab58db5be4 service nova] Enqueued Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_rules [ 823.098882] env[62815]: INFO networking_nsxv3.common.synchronization [req-852d8357-f7a2-4640-b98d-f17d251f2d31 req-de9fb2a7-784c-4781-a50a-85ab58db5be4 service nova] Enqueued Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_members [ 823.099044] env[62815]: INFO networking_nsxv3.common.synchronization [req-852d8357-f7a2-4640-b98d-f17d251f2d31 req-de9fb2a7-784c-4781-a50a-85ab58db5be4 service nova] Enqueued Resource ID: f825989b-8c11-47bc-b0a8-c3d0fb82fc27 with Priority: HIGHEST for action port [ 823.099284] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_rules [ 823.099413] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_members [ 823.099510] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825989b-8c11-47bc-b0a8-c3d0fb82fc27 with Priority: HIGHEST for action port [ 823.100720] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.100851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.100923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.101203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.101315] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.102146] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.102297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.102324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.102811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.102965] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.103356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.103356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.103433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.104385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.104385] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.104805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.104982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.105073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.105411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.105411] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f825989b-8c11-47bc-b0a8-c3d0fb82fc27',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.607152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.607444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.607480] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.608367] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f825989b-8c11-47bc-b0a8-c3d0fb82fc27 with status ACTIVE [ 823.608549] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.608661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.608746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.608953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.609057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.609230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.609324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.609386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.609536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.609611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.609787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.609878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.609937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.610087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.610162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.610245] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f825989b-8c11-47bc-b0a8-c3d0fb82fc27 is going to be updated. [ 823.631155] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.631295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 823.631349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.631542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 823.631697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 823.631846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f825989b-8c11-47bc-b0a8-c3d0fb82fc27" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.112143] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.195359] env[62815]: INFO networking_nsxv3.common.synchronization [req-40129c14-c55b-4544-a5cf-67775b87ef70 req-12c6e00c-20e4-415e-8f91-d0ca04d6cba7 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 824.195853] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 824.196179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.196298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.196367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.196564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.196705] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.196799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.196858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.197536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.197536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.197536] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.591594] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.592160] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.592160] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.592320] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.592462] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.592624] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.592750] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.592970] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.593292] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.593515] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.593631] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.593750] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.593868] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.593981] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.594105] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.594243] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.615122] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.615416] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 824.615452] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.615760] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-612" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.615930] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.616121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.616246] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.616547] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.616692] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77a48cea-ee4e-4c3c-9bfd-3b42fe099b41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.618732] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.618877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.618926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.619087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.619174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.619264] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71609a59-7de6-462b-b6e5-244b95f4175c is going to be created. [ 824.640177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.640370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.640403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.640580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.640795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.649139] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71609a59-7de6-462b-b6e5-244b95f4175c in Status: UNINITIALIZED for 2s [ 824.700701] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.120039] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.120039] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.120039] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.120327] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.120503] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.120691] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 not found, creating... [ 825.121097] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.121299] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.121432] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.121683] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.121870] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.122239] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.122355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.122481] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.122710] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.122898] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.123122] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 is going to be created. [ 825.142104] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.142296] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.142468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.142647] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.142881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.143115] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.202091] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.707042] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.707042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.707042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.707042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.707042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.707042] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 825.737897] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.737897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.737897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.737897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.737897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.747120] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 826.011179] env[62815]: INFO networking_nsxv3.common.synchronization [req-40129c14-c55b-4544-a5cf-67775b87ef70 req-198cef53-9d87-413d-8868-5c70f282052b service nova] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 826.011179] env[62815]: INFO networking_nsxv3.common.synchronization [req-40129c14-c55b-4544-a5cf-67775b87ef70 req-198cef53-9d87-413d-8868-5c70f282052b service nova] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 826.011179] env[62815]: INFO networking_nsxv3.common.synchronization [req-40129c14-c55b-4544-a5cf-67775b87ef70 req-198cef53-9d87-413d-8868-5c70f282052b service nova] Enqueued Resource ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with Priority: HIGHEST for action port [ 826.011179] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 826.011179] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 826.011179] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with Priority: HIGHEST for action port [ 826.011841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.012114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.012294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.012641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.012887] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.014263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.014487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.015756] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.015756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.015756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.015756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.015756] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77a48cea-ee4e-4c3c-9bfd-3b42fe099b41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.518588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.518588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.518588] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with status ACTIVE [ 826.518764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.518821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.518898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.519101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.519188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.519357] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.519456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.519516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.519660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.519741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.519934] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.520037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.520096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.520233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.520303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.520414] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 is going to be updated. [ 826.546129] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.546483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.546483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.546592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.546669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.546867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.659149] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71609a59-7de6-462b-b6e5-244b95f4175c in Status: SUCCESS [ 826.659386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.659537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.659744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.659936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.660069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.660129] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.660262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.660345] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.660429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.660521] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.746566] env[62815]: INFO networking_nsxv3.common.synchronization [req-00052edc-659d-4c73-a97f-ff5a7864a79f req-ff9c700b-c008-446b-8297-c342c95ce062 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 826.747505] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 826.747824] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.747952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.748209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.748475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.748664] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.748775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.748841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.748998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.749109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.749233] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.162460] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.162629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.162690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.162916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.163092] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.163199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.163264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.163412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.163523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.163581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.163727] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.163820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.163879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.164032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.164169] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.164259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.164320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.164452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.164526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.164606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.164700] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.251758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.251979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.252063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.252293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.273656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.273993] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.274166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.274248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.274529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.274665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.274814] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 827.320573] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.320770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.320848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.321080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.321229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.334067] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 827.527370] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.527583] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.527712] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.528018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.528712] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.529564] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.529751] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.530000] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.530175] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.530396] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.530524] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.530639] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.530801] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.530935] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.531059] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.531199] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.556161] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.556363] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.556532] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.556692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.557030] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-16ee0e30-467e-46ec-8f43-e35ae5c18b01 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.557231] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.557379] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.557732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.557893] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ee0e30-467e-46ec-8f43-e35ae5c18b01',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.667262] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71609a59-7de6-462b-b6e5-244b95f4175c: rpc.has_security_group_logging(os_id): False [ 827.685124] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.685379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.685379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.685577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.685648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.685853] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.685986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.686065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.686173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.686242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.686424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.686533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.686588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.686707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.686782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.686961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.687061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.687117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.687257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.687325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.687414] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71609a59-7de6-462b-b6e5-244b95f4175c is going to be created. [ 827.764749] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 827.765038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.765140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.765350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.765530] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.765647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.765715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.765865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.765972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.766093] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.767731] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.767819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.767872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.768443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.768443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.784022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71609a59-7de6-462b-b6e5-244b95f4175c in Status: IN_PROGRESS for 2s [ 828.060025] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.060313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.060451] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.060760] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.060939] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.061122] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 16ee0e30-467e-46ec-8f43-e35ae5c18b01 not found, creating... [ 828.061467] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.061650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.061804] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.062068] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.062269] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.062551] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.062720] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.062847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.063238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.063238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.063474] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 16ee0e30-467e-46ec-8f43-e35ae5c18b01 is going to be created. [ 828.084175] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.084489] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.084664] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.084967] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.085261] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.085545] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.271689] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.773942] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.005215] env[62815]: INFO networking_nsxv3.common.synchronization [req-00052edc-659d-4c73-a97f-ff5a7864a79f req-25d60814-4adb-4df4-8813-4d25f3f03cb4 service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 829.005215] env[62815]: INFO networking_nsxv3.common.synchronization [req-00052edc-659d-4c73-a97f-ff5a7864a79f req-25d60814-4adb-4df4-8813-4d25f3f03cb4 service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 829.005708] env[62815]: INFO networking_nsxv3.common.synchronization [req-00052edc-659d-4c73-a97f-ff5a7864a79f req-25d60814-4adb-4df4-8813-4d25f3f03cb4 service nova] Enqueued Resource ID: 16ee0e30-467e-46ec-8f43-e35ae5c18b01 with Priority: HIGHEST for action port [ 829.006998] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 829.009523] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 829.009523] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ee0e30-467e-46ec-8f43-e35ae5c18b01 with Priority: HIGHEST for action port [ 829.009523] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.009523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.009523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.009523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.009523] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.010339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.010339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.011575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-16ee0e30-467e-46ec-8f43-e35ae5c18b01 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.011575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.011575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.011575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.011575] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ee0e30-467e-46ec-8f43-e35ae5c18b01',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.276470] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.276579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.276711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.277111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.277111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.277111] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 829.304889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.305058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.305133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.305353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.305495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.313543] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 829.342595] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 829.342867] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 829.343017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.344056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.344056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.344056] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.344056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.344056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.344056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.344056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.344351] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.514511] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.514511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.514511] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16ee0e30-467e-46ec-8f43-e35ae5c18b01 with status ACTIVE [ 829.514745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.514745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.514745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.514948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.515147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.515592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.515709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.515775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.515957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.516052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.516293] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.516428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.516492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.516639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.516716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.516801] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16ee0e30-467e-46ec-8f43-e35ae5c18b01 is going to be updated. [ 829.537079] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.537232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.538384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.538692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.538851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.539037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16ee0e30-467e-46ec-8f43-e35ae5c18b01" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.797083] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71609a59-7de6-462b-b6e5-244b95f4175c in Status: SUCCESS [ 829.797389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.846947] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.349479] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.821015] env[62815]: INFO networking_nsxv3.common.synchronization [req-370b6749-14c9-481a-9996-6b8482900d8a req-fb3aa65b-76f7-4fae-8cfb-c94b38e3eff0 tempest-ServersAdminNegativeTestJSON-39006248 tempest-ServersAdminNegativeTestJSON-39006248-project-member] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 830.821566] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGHEST for action security_group_members [ 830.821878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.821997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.822081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.822285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.822481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.822551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.822580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.822720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.822806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.822897] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.852280] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.852552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.852654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.852901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.853032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.853449] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 830.881224] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.881424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.881424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.881646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.881867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.890893] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 831.326423] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.326423] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.326423] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.326423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.326423] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be updated. [ 831.327197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.327368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.327520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.327619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.327683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.327823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.327899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.327978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.328083] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.359611] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.359726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.359797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.359995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.360143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.368047] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: IN_PROGRESS for 2s [ 831.713388] env[62815]: INFO networking_nsxv3.common.synchronization [req-84bccb49-eca5-4b3c-80c5-4f07679b2a25 req-c417cf18-c455-4031-904f-f25024457cca tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 831.717025] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 831.717025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.717025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.717025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.717025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.831755] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.832099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.832099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.832389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.832594] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.832772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.832882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.833131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.833282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.833455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.833688] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.833873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.833994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.834215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.834370] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.834469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.834531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.834705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.834793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.834890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.834991] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.219549] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.342032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6d0cd-3c56-42cd-8d37-8158526e935b: rpc.has_security_group_logging(os_id): False [ 832.365944] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.365944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.365944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.366132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.389253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.389552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.389691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.389760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.389962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.390061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.390270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.390371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.390434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.390604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.390683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.390929] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.391035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.391094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.391253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.391534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.391534] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 832.473369] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.473585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.473585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.473819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.473970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.488770] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 832.501840] env[62815]: INFO networking_nsxv3.common.synchronization [req-b63b3af9-faa3-46d0-8809-f9e11e3ae4f9 req-f5b37166-be74-4d44-a6a6-77ddfc9d2371 tempest-AttachInterfacesV270Test-334309949 tempest-AttachInterfacesV270Test-334309949-project-member] Enqueued Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_members [ 832.502393] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_members [ 832.502829] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.502829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.502974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.503140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.503294] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.503388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.503447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.506042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.506042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.506042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.722098] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.779020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.779221] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.779444] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.779706] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.779996] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.780191] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.780313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.780536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.780688] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.781118] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.781282] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.781438] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.781565] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.781694] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.781900] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.782096] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.799380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.799578] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.799741] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.799961] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-583" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.800320] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-c6b193da-ccf9-4886-b698-7f556305d02a taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.800521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.800677] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.801125] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.801195] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b193da-ccf9-4886-b698-7f556305d02a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.900020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 832.900373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.900443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.900638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.900894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.901017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.901084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.901240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.901326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.901408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.901497] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.009565] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.009565] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.009565] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d already deleted. [ 833.009565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.224999] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.224999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.224999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.224999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.225211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.225211] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 833.254287] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.254444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.254525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.254753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.254915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.263478] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 833.303213] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.303496] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.303630] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.303914] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.304100] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.304266] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port c6b193da-ccf9-4886-b698-7f556305d02a not found, creating... [ 833.304525] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.305177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.305177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.305177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.305177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.305436] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.305597] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.305719] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.305924] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.306079] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.306223] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: c6b193da-ccf9-4886-b698-7f556305d02a is going to be created. [ 833.324553] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.325129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.325129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.325129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.325330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.325549] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.378844] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f in Status: SUCCESS [ 833.379055] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f deletion is rescheduled due to dependency. [ 833.379175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.403919] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.404069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.404142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.404360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.404523] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.404622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.404688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.404875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.404969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.405074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.405226] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.405319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.405381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.405522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.405657] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.405748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.405841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.405937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.406022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.406101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.406192] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.911681] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95315c29-36f4-4fb3-afae-f96b062c5650: rpc.has_security_group_logging(os_id): False [ 833.928450] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.928633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.928721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.928970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.929097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.929350] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.929467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.929536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.929699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.929795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.929991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.930109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.930180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.930312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.930383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.930582] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.930684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.930753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.930928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.931292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.931292] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 833.987066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.987219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.987312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.987586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.987766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.999919] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 834.068784] env[62815]: INFO networking_nsxv3.common.synchronization [req-b63b3af9-faa3-46d0-8809-f9e11e3ae4f9 req-82f8c36d-a28c-4068-98c7-e364003bd0a5 service nova] Enqueued Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_rules [ 834.068978] env[62815]: INFO networking_nsxv3.common.synchronization [req-b63b3af9-faa3-46d0-8809-f9e11e3ae4f9 req-82f8c36d-a28c-4068-98c7-e364003bd0a5 service nova] Enqueued Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_members [ 834.069142] env[62815]: INFO networking_nsxv3.common.synchronization [req-b63b3af9-faa3-46d0-8809-f9e11e3ae4f9 req-82f8c36d-a28c-4068-98c7-e364003bd0a5 service nova] Enqueued Resource ID: c6b193da-ccf9-4886-b698-7f556305d02a with Priority: HIGHEST for action port [ 834.069661] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_rules [ 834.069778] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_members [ 834.069883] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b193da-ccf9-4886-b698-7f556305d02a with Priority: HIGHEST for action port [ 834.070356] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.070483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.070552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.072234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.072234] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.072612] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.074646] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.074646] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.074646] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b193da-ccf9-4886-b698-7f556305d02a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.074646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.075199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.075682] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b193da-ccf9-4886-b698-7f556305d02a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.459737] env[62815]: INFO networking_nsxv3.common.synchronization [req-343478bc-de83-4cce-8d9d-071119218b3a req-f802c8bc-6c12-4285-aeda-2ec8a8a5f031 tempest-ServerPasswordTestJSON-762240649 tempest-ServerPasswordTestJSON-762240649-project-member] Enqueued Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_members [ 834.460603] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71609a59-7de6-462b-b6e5-244b95f4175c with Priority: HIGHEST for action security_group_members [ 834.460603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-71609a59-7de6-462b-b6e5-244b95f4175c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.460755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.460755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.464025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.464025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.464025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.464025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.464025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.464025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.464025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71609a59-7de6-462b-b6e5-244b95f4175c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.504727] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 834.508023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.577802] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6b193da-ccf9-4886-b698-7f556305d02a with status ACTIVE [ 834.578065] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.578207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.578289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.578511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.578699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.578806] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.578928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.578928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.579198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.579280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.579464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.579557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.579620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.579762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.579836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.579923] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6b193da-ccf9-4886-b698-7f556305d02a is going to be updated. [ 834.581122] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.581223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.581424] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.601119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.601276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.601312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.601499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.601629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.601791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b193da-ccf9-4886-b698-7f556305d02a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.965016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.965299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.965299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.965556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.965660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.965868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.965968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.966099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.966221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.966297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.966399] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71609a59-7de6-462b-b6e5-244b95f4175c is going to be updated. [ 834.993634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.993855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.993931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.994156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.994376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.015478] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71609a59-7de6-462b-b6e5-244b95f4175c in Status: IN_PROGRESS for 2s [ 835.083928] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.273408] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 835.273683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.586509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.586654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.586735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.586931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.587037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.587144] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d is going to be created. [ 835.612619] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.612762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.612893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.613060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.613228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.623967] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d in Status: UNINITIALIZED for 2s [ 836.013148] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 836.013496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.516396] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 836.516591] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 836.517184] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 836.517746] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 836.518157] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.518291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.518356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.518642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.518802] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.518911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.518971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.519144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.519232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.519323] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.520200] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.520314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.520381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.520530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.520671] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.520765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.520868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.520994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.521087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.521171] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.557181] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 836.557372] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 836.557526] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_rules [ 836.557660] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 836.557793] env[62815]: INFO networking_nsxv3.common.synchronization [req-8b9db39e-958c-4297-a7ef-b9a7b62e68e1 req-88deeec1-ee99-4718-8080-0a561255d453 tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with Priority: HIGHEST for action port [ 836.558029] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 836.558155] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_rules [ 836.558253] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with Priority: HIGHEST for action port [ 836.558344] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 836.558432] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 836.559436] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.559560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.559674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.559825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.559946] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.560860] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.561047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.561083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.561266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.561343] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.562048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.562343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.562416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.562565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.562636] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77a48cea-ee4e-4c3c-9bfd-3b42fe099b41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.563375] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.563465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.563653] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.563732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.023350] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.024999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71609a59-7de6-462b-b6e5-244b95f4175c in Status: SUCCESS [ 837.025188] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71609a59-7de6-462b-b6e5-244b95f4175c deletion is rescheduled due to dependency. [ 837.025301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71609a59-7de6-462b-b6e5-244b95f4175c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.025973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.065162] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.065292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.065550] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.065639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.065794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with status ACTIVE [ 837.065953] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.066066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.066131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.066338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.066427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.066588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.066679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.066739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.066883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.066958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.067146] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.067254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.067313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.067451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.067522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.067603] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 is going to be updated. [ 837.086873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.087017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.087059] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.087237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.087368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.087515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.270111] env[62815]: INFO networking_nsxv3.common.synchronization [req-db938ba4-817f-459e-bacd-6b9e8b5e558b req-fdbc4e5f-b3a7-4a81-8ad8-501c80ab8cc4 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_members [ 837.270111] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_members [ 837.270111] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.270111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.270111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.270111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.271212] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.271505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.271694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.271970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.272188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.272931] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.527490] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.528439] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.621909] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.622108] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.622238] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.622528] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.622796] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.622959] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.623106] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.624143] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.624143] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.624143] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.624143] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.624143] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.624468] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.624468] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.624468] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.624627] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.634296] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d in Status: SUCCESS [ 837.634911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.635102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.635314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.635497] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.635624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.636028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.636028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.636028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.636028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.636250] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.642925] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.643120] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.643291] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.643592] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.643986] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-38fbf7e2-1225-4963-a52c-e27d7d6be403 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.644270] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.644429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.644843] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.645064] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38fbf7e2-1225-4963-a52c-e27d7d6be403',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.775820] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.775820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.775820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.775820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.775820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.776178] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.776178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.776178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.776308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.776308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.776384] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 already deleted. [ 837.776552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.030503] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.030795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.030795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.030983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.031092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.031194] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be created. [ 838.032484] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.032606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.032676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.032840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.032922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.033018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 838.056425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.056562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.056634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.056833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.056990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.058595] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.058722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.058789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.058975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.059115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.069654] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 838.070501] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: UNINITIALIZED for 2s [ 838.138096] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.138275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.138375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.138578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.138748] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.138860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.138918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.139077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.139165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.139289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.139395] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.139485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.139544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.139683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.139818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.139908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.139967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.140114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.140189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.140268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.140355] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.147610] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.147887] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.148022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.148190] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.148745] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.148745] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 38fbf7e2-1225-4963-a52c-e27d7d6be403 not found, creating... [ 838.148745] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.148914] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.148985] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.149231] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.149353] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.149654] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.149815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.149941] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.150169] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.150309] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.150453] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 38fbf7e2-1225-4963-a52c-e27d7d6be403 is going to be created. [ 838.172170] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.172394] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.172525] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.172794] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.173036] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.173269] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.642726] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35be23b-c5a4-4440-8ddb-1a5f961d3c7d: rpc.has_security_group_logging(os_id): False [ 838.666955] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.667115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.667201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.667436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.667535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.667756] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.667907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.668176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.668591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.668591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.668679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.668807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.670056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.670056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.670056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.670056] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.670056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.670056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.670056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.670502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.670502] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d is going to be created. [ 838.760019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.760019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.760019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.760019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.760019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.772277] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d in Status: IN_PROGRESS for 2s [ 838.949510] env[62815]: INFO networking_nsxv3.common.synchronization [req-db938ba4-817f-459e-bacd-6b9e8b5e558b req-4e1767d2-1761-454b-89c4-f7268cd16278 service nova] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_rules [ 838.949763] env[62815]: INFO networking_nsxv3.common.synchronization [req-db938ba4-817f-459e-bacd-6b9e8b5e558b req-4e1767d2-1761-454b-89c4-f7268cd16278 service nova] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_members [ 838.949948] env[62815]: INFO networking_nsxv3.common.synchronization [req-db938ba4-817f-459e-bacd-6b9e8b5e558b req-4e1767d2-1761-454b-89c4-f7268cd16278 service nova] Enqueued Resource ID: 38fbf7e2-1225-4963-a52c-e27d7d6be403 with Priority: HIGHEST for action port [ 838.950529] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_rules [ 838.950712] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_members [ 838.950865] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fbf7e2-1225-4963-a52c-e27d7d6be403 with Priority: HIGHEST for action port [ 838.951228] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.951391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.951481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.951699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.951824] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.952772] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.952933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.953015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.953248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.953405] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.953507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.953591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.953736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.953826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 838.953942] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.955379] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-38fbf7e2-1225-4963-a52c-e27d7d6be403 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.955504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 838.955603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.955936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 838.955936] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38fbf7e2-1225-4963-a52c-e27d7d6be403',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.458359] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.458650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.458696] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.460065] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38fbf7e2-1225-4963-a52c-e27d7d6be403 with status ACTIVE [ 839.460065] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.460065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.460065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.460608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.460608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.460608] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.460608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.460608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.460866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.460866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.460966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.461058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.461114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.461284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.461361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.461490] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38fbf7e2-1225-4963-a52c-e27d7d6be403 is going to be updated. [ 839.482326] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.482480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 839.482534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.482732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 839.482950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.483045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38fbf7e2-1225-4963-a52c-e27d7d6be403" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 839.963912] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.087022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.087022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.087022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.087022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.087970] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 840.088298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.088562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.090578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.090578] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.090578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.090578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.090578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.090578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.090578] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.466932] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.467216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.467216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.467524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.467575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.467708] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 is going to be created. [ 840.492078] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.492216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.492311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.492486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.492641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.503696] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17388f1d-f975-4b0c-9539-e72fee58d139 in Status: UNINITIALIZED for 2s [ 840.592148] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.592316] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.790732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d in Status: SUCCESS [ 840.790829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.093942] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.094844] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.596389] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.596782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.596782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.596856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.596957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.597033] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 841.598322] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.598442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.598509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.598675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.598756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.598858] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be updated. [ 841.631788] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.632879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.632879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.632879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.632879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.635568] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.635714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.635810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.636580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.636755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.646017] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: IN_PROGRESS for 2s [ 841.646672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 842.143526] env[62815]: INFO networking_nsxv3.common.synchronization [req-60fa29b1-dce9-4574-8e9c-d1b2b8902ea6 req-620a0e76-ab28-4e8d-a1fa-1130cf10d0fe tempest-ListServerFiltersTestJSON-1707760047 tempest-ListServerFiltersTestJSON-1707760047-project-member] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 842.144074] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGHEST for action security_group_members [ 842.144371] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.144499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.144567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.144896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.145085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.145225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.145294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.145464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.145552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.145646] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.514323] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17388f1d-f975-4b0c-9539-e72fee58d139 in Status: SUCCESS [ 842.514323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.514323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.514323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.514814] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.514814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.514814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.515018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.515167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.515306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.515447] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.648437] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.648749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.648749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.648893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.649234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.649454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.649559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.649623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.649789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.649869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.649956] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be updated. [ 842.676204] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.676372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.676409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.676964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.677135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.684971] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: IN_PROGRESS for 2s [ 842.745778] env[62815]: INFO networking_nsxv3.common.synchronization [req-e5231848-b5c5-4cb5-910d-4902e8ff5862 req-7b96c8fb-d325-49df-8c78-bf2d736d49d1 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 842.746431] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 842.746643] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.746767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.746834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.751227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.751335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.751430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.751499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.751671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.751760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.751886] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.017981] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.085086] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.085086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.085086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.085086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.085086] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.085086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.085086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.085745] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.086045] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.086948] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.086948] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.086948] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.086948] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.087220] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.087388] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.087572] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.105612] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.105805] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.105950] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.106147] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.106446] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-002976cf-eb7d-4e86-b92b-166c6200237a taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.106616] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.106740] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.107094] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.107284] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002976cf-eb7d-4e86-b92b-166c6200237a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.258264] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.258264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.258418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.258571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.258677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.258909] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.259031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.259097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.259288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.259386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.259485] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 843.287397] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.287559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.287651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.287976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.288115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.296215] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 843.374019] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 843.374277] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_members [ 843.374495] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 843.375528] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 843.375528] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_members [ 843.375528] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 843.375907] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.376584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.376584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-054dc81d-0657-423c-a15a-59f5f057df0b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.376584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.376584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.376812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.377377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.377377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.377377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.377377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.377649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.377727] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.378942] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.378942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.439535] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_rules [ 843.439797] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_members [ 843.439958] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 843.440265] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 843.440441] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_rules [ 843.441217] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 843.441479] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc68cbfe-9651-4499-a1d0-48bfc86d469c req-444916c9-bd51-43d0-b746-91945b873c3f tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with Priority: HIGHEST for action port [ 843.442267] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_rules [ 843.442565] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_rules [ 843.442888] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 843.443221] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with Priority: HIGHEST for action port [ 843.443462] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_rules [ 843.443729] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_members [ 843.443906] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 843.444843] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-054dc81d-0657-423c-a15a-59f5f057df0b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.444989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.445074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.445353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.445728] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.446820] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.447819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.447819] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.447819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.447819] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.447819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.447819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.448170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.448478] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77a48cea-ee4e-4c3c-9bfd-3b42fe099b41',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.449215] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.449403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.449644] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-054dc81d-0657-423c-a15a-59f5f057df0b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.449793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.450626] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.450626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.520351] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17388f1d-f975-4b0c-9539-e72fee58d139: rpc.has_security_group_logging(os_id): False [ 843.537773] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.537953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.538058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.538322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.538436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.538705] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.538827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.540027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.540027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.540027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.540027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 is going to be created. [ 843.595553] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.595731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.595837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.596111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.596302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.607372] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17388f1d-f975-4b0c-9539-e72fee58d139 in Status: IN_PROGRESS for 2s [ 843.609989] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.610207] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.610359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.610633] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.610788] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.610994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 002976cf-eb7d-4e86-b92b-166c6200237a not found, creating... [ 843.611518] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.611518] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.611654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.611768] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.611933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.612242] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.612430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.612542] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.612756] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.612925] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.613051] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 002976cf-eb7d-4e86-b92b-166c6200237a is going to be created. [ 843.629881] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.630120] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.630391] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.630538] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.630762] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.631065] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.655235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 843.655519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.655618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.655821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.656030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.656152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.656220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.656375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.656457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.656543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.656641] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.658028] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 843.658216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.658373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.658532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.658696] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.658832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.658914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.659032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.659295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.659295] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.660928] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.660928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.660928] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.661967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.661967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.662036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.662126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.662166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.662311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.662432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.662478] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.881550] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.951842] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-054dc81d-0657-423c-a15a-59f5f057df0b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.952027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.952311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 with status ACTIVE [ 843.952570] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.952740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.952844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.953166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.953309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.953552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.953673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.953739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.953922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.954018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.954204] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.954312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.954361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.954504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.954579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.954662] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77a48cea-ee4e-4c3c-9bfd-3b42fe099b41 is going to be updated. [ 843.975156] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.975284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.975347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.975584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.975737] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.975912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77a48cea-ee4e-4c3c-9bfd-3b42fe099b41" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.162388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.162565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.164496] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.165422] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.166149] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.384362] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.402899] env[62815]: INFO networking_nsxv3.common.synchronization [req-e5231848-b5c5-4cb5-910d-4902e8ff5862 req-0e7ef22f-ee54-4dc2-83b9-14a80c410567 service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 844.403791] env[62815]: INFO networking_nsxv3.common.synchronization [req-e5231848-b5c5-4cb5-910d-4902e8ff5862 req-0e7ef22f-ee54-4dc2-83b9-14a80c410567 service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 844.404830] env[62815]: INFO networking_nsxv3.common.synchronization [req-e5231848-b5c5-4cb5-910d-4902e8ff5862 req-0e7ef22f-ee54-4dc2-83b9-14a80c410567 service nova] Enqueued Resource ID: 002976cf-eb7d-4e86-b92b-166c6200237a with Priority: HIGHEST for action port [ 844.405485] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 844.407752] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 844.407871] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002976cf-eb7d-4e86-b92b-166c6200237a with Priority: HIGHEST for action port [ 844.408583] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.408726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.408782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.408985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.409080] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.410182] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.410314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.410539] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-002976cf-eb7d-4e86-b92b-166c6200237a taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.410675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.410753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.411029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.413571] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002976cf-eb7d-4e86-b92b-166c6200237a',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.668423] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3b25207-a990-4fd7-b877-b071ab01d2a7: rpc.has_security_group_logging(os_id): False [ 844.669786] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.670698] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.687528] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.687669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.687734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.687938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.688037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.688256] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.688355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.688418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.688630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.688630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.688748] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be created. [ 844.697200] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b341d199-0570-4483-a66b-c412fafde85f in Status: SUCCESS [ 844.697380] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b341d199-0570-4483-a66b-c412fafde85f deletion is rescheduled due to dependency. [ 844.697508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.749609] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.749609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.749609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.749798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.749973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.760136] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: IN_PROGRESS for 2s [ 844.887148] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.887148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.887148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.887435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.887435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.887497] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 054dc81d-0657-423c-a15a-59f5f057df0b is going to be created. [ 844.915279] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.915279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.916619] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 002976cf-eb7d-4e86-b92b-166c6200237a with status ACTIVE [ 844.916843] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.917017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.917967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.917967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.917967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.917967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.917967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.917967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.918296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.918296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.918794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.918794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.918794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.918994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.919127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.919257] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 002976cf-eb7d-4e86-b92b-166c6200237a is going to be updated. [ 844.921026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.921131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.921224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.921415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.921545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.930493] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 054dc81d-0657-423c-a15a-59f5f057df0b in Status: UNINITIALIZED for 2s [ 844.940800] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.941081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.941081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.941307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.941404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.941563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-002976cf-eb7d-4e86-b92b-166c6200237a" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.175834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.176021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.176021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.176456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.176456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.176556] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be updated. [ 845.177964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.178135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.178194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.178360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.178448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.178537] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 845.209349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.209505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.209581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.209934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.210026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.212860] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.212981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.213064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.213440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.227817] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: IN_PROGRESS for 2s [ 845.230422] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 845.305022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 845.305187] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 845.305307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.305478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.305695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.305911] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.306055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.306123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.306339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.306394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.306459] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.619570] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17388f1d-f975-4b0c-9539-e72fee58d139 in Status: SUCCESS [ 845.619570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.810185] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.314955] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.774027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 846.774235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.774408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.774636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.774723] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.816742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.817167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.817167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.817298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.817298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.817400] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 846.844722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.844882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.844916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.845139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.845300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.853160] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 846.949185] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 054dc81d-0657-423c-a15a-59f5f057df0b in Status: SUCCESS [ 846.949273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.949408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.949623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.949804] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.949922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.949988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.950147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.950230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.950325] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.239685] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 847.239963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.240220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.241352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.241352] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.241352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.241352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.241352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.241796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.241796] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.246735] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 847.247084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.247277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.247534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.247764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.247916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.248011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.248216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.248328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.248497] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.277060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.277060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.455409] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.504974] env[62815]: INFO networking_nsxv3.common.synchronization [req-47c0e2b9-79ee-4746-8708-912bb514512f req-44956876-9ead-4bc9-a0cc-5971071ade1d tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_members [ 847.505312] env[62815]: INFO networking_nsxv3.common.synchronization [req-47c0e2b9-79ee-4746-8708-912bb514512f req-44956876-9ead-4bc9-a0cc-5971071ade1d tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 847.505659] env[62815]: INFO networking_nsxv3.common.synchronization [req-47c0e2b9-79ee-4746-8708-912bb514512f req-44956876-9ead-4bc9-a0cc-5971071ade1d tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 847.507777] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 054dc81d-0657-423c-a15a-59f5f057df0b with Priority: HIGHEST for action security_group_members [ 847.507777] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGHEST for action security_group_members [ 847.507777] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 847.507935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-054dc81d-0657-423c-a15a-59f5f057df0b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.508249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.508510] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.508632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.508849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.508962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.745476] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.750642] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.958042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.014594] env[62815]: INFO networking_nsxv3.common.synchronization [req-89cdec46-881c-422f-b551-04c8d4da0c4f req-7f37136e-9375-42ca-88eb-f394a7e6d5eb tempest-AttachInterfacesV270Test-334309949 tempest-AttachInterfacesV270Test-334309949-project-member] Enqueued Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_members [ 848.017980] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGHEST for action security_group_members [ 848.017980] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.017980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.017980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.017980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.017980] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.017980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.018352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.018352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.018352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.018446] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.248060] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.252753] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.461155] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.461329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.461388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.461624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.461781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.461838] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 054dc81d-0657-423c-a15a-59f5f057df0b is going to be updated. [ 848.517685] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.517842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.517922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.518172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.518430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.521200] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.521351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.521424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.521596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.521693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.521926] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.522052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.522114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.522327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.522481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.522513] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d is going to be updated. [ 848.528526] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 054dc81d-0657-423c-a15a-59f5f057df0b in Status: IN_PROGRESS for 2s [ 848.558309] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.559404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.559404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.559404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.559404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.568236] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d in Status: IN_PROGRESS for 2s [ 848.750590] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.750746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.750823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.751197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.751327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.751445] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be updated. [ 848.755437] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.755562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.755615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.755850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.755945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.756072] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 848.791200] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.791342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.791408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.791679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.791826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.793488] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.793598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.793666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.793858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.793985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.805052] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: IN_PROGRESS for 2s [ 848.805623] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 848.862415] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 848.862664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.862982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.863243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.863455] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.863575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.863642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.863799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.863883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.863987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.864093] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.366809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.366809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.366809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.366809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.367268] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.367268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.367268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.367479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.367479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.367593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.367716] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.367807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.367861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.368011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.368161] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.368255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.368315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.368701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.368701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.368701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.368701] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.871512] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6021d487-9de7-424f-8bb7-283b2180f7a7: rpc.has_security_group_logging(os_id): False [ 849.890241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.890386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.890539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.890707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.890838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.891134] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.891227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.891296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.891455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.891539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.891747] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.891845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.891903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.892134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.892134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.892306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.892520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.892520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.892639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.892710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.892822] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 849.961430] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.961430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.961528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.961792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.961857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.973532] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 850.538988] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 054dc81d-0657-423c-a15a-59f5f057df0b in Status: SUCCESS [ 850.539368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.539423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.539616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.539811] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.539921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.539987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.540153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.540234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.540317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.540413] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.542058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.542423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.542619] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.542733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.542789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.542964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.543056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.543148] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.577459] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d in Status: SUCCESS [ 850.577690] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d deletion is rescheduled due to dependency. [ 850.577830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.816601] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.816601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.816601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.816939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.816939] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.818223] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 850.818410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.818555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.818717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.818914] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.818969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.819052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.819190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.819268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.819358] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.820120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.820280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.820654] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.820654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.820654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.821317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.821317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.821317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.821317] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.821317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.821317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.821317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.821552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.821552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.821629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.821767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.821819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.821868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.821922] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.822926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.823128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.823291] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.823373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.823436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.823578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.823656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.823739] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.042701] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('054dc81d-0657-423c-a15a-59f5f057df0b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.045392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.045905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.045905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.045905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.046109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.046251] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.046372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.046456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.046856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.046856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.047134] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 054dc81d-0657-423c-a15a-59f5f057df0b is going to be deleted. [ 851.081156] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.081699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.081699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.081900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.082070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.082193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.323438] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.324554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.324702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.324774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.325077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.325273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.325438] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.326252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.326252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.326252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.326252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.326252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be updated. [ 851.326949] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6d0cd-3c56-42cd-8d37-8158526e935b: rpc.has_security_group_logging(os_id): False [ 851.328606] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.348177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.348177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.348177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.348177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.348625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.348625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.349856] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.349856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.349856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.349856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.349856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.349856] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 851.354348] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.354452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.354556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.354793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.354954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.364070] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: IN_PROGRESS for 2s [ 851.407760] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.407944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.408055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.409903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.409903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.420144] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 851.545266] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 054dc81d-0657-423c-a15a-59f5f057df0b: rpc.has_security_group_logging(os_id): False [ 851.574334] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.574334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.574334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.574334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.574334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.574727] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.574727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.574727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.574849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.574884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.574965] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 054dc81d-0657-423c-a15a-59f5f057df0b is going to be created. [ 851.602396] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/054dc81d-0657-423c-a15a-59f5f057df0b], does not exist path=[/infra/domains/default/groups/054dc81d-0657-423c-a15a-59f5f057df0b]."\n}' [ 851.602572] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 054dc81d-0657-423c-a15a-59f5f057df0b failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/054dc81d-0657-423c-a15a-59f5f057df0b [ 851.602657] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 851.641774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.641964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.642527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.642527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.643246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.643499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.643743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.643743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.643903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.643903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.644081] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.644178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.644239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.644380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.644454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.644540] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 054dc81d-0657-423c-a15a-59f5f057df0b is going to be created. [ 851.661759] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/054dc81d-0657-423c-a15a-59f5f057df0b], does not exist path=[/infra/domains/default/groups/054dc81d-0657-423c-a15a-59f5f057df0b]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/054dc81d-0657-423c-a15a-59f5f057df0b [ 851.661938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-054dc81d-0657-423c-a15a-59f5f057df0b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.662476] env[62815]: Traceback (most recent call last): [ 851.662536] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 851.662536] env[62815]: return func(*args, **kwargs) [ 851.662536] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 851.662536] env[62815]: res.raise_for_status() [ 851.662536] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 851.662536] env[62815]: raise HTTPError(http_error_msg, response=self) [ 851.662536] env[62815]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/054dc81d-0657-423c-a15a-59f5f057df0b [ 851.662536] env[62815]: During handling of the above exception, another exception occurred: [ 851.662536] env[62815]: Traceback (most recent call last): [ 851.662536] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 851.662536] env[62815]: listener.cb(fileno) [ 851.662536] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 851.662536] env[62815]: result = function(*args, **kwargs) [ 851.662536] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 851.662536] env[62815]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 851.662536] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 851.662536] env[62815]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 851.662536] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 851.662536] env[62815]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 851.662536] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 851.662536] env[62815]: res.raise_for_status() [ 851.662536] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 851.662536] env[62815]: raise HTTPError(http_error_msg, response=self) [ 851.662536] env[62815]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/054dc81d-0657-423c-a15a-59f5f057df0b [ 851.663220] env[62815]: Removing descriptor: 24 [ 851.830989] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3b25207-a990-4fd7-b877-b071ab01d2a7: rpc.has_security_group_logging(os_id): False [ 851.832169] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.849915] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.850099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.850172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.850614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.866615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.866854] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.867156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.867288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.867653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.867653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.867805] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be updated. [ 851.927270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.927432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.927432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.927643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.927794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.943105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: IN_PROGRESS for 2s [ 851.984242] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 851.984777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.335034] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.335034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 852.335034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.335292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.335292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.335292] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 852.372176] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.372350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 852.372394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.372809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.372809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.381612] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 853.018055] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.018364] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 853.375200] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 853.375976] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 deletion is rescheduled due to dependency. [ 853.375976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.431122] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 853.432418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 853.432630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.432873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 853.432968] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.935534] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.935682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 853.951512] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 in Status: SUCCESS [ 853.951732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.391688] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 854.391942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.392150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.392367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.392715] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.392715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.392840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.392939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.393011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.393126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.393274] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.895620] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.895804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.895884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.896093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.896387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.896387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.896508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.896607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.896679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.896783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.896890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.896971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.897054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.897201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.897336] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.897436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.897495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.897600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.897677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.897762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.897846] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.401565] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6d0cd-3c56-42cd-8d37-8158526e935b: rpc.has_security_group_logging(os_id): False [ 855.417757] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.417757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.417757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.417757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.434579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.435786] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.435786] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.435786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.436205] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.436205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.436205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.436309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.436340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.436414] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 855.491415] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.491549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.491710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.492167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.505583] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 856.715836] env[62815]: INFO networking_nsxv3.common.synchronization [req-6b252477-3127-4fef-bafc-27eb4d98a4e3 req-d480d7bf-0992-45b5-8bc4-950a90f6bb35 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 856.719688] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 856.720063] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.720195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.720264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.720469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.720673] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.720722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.720787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.720936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.723125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.723125] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.724050] env[62815]: INFO networking_nsxv3.common.synchronization [req-a13463e8-1ebe-432d-a19d-73a3a4a82a41 req-2a23a9fe-ca16-4623-b046-064971ef3060 tempest-ListServersNegativeTestJSON-1738427851 tempest-ListServersNegativeTestJSON-1738427851-project-member] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 856.726418] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 856.726686] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.726806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.726864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.727044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.727538] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.727538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.727538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.727538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.727707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.727707] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.825450] env[62815]: INFO networking_nsxv3.common.synchronization [req-8c2c41b2-a778-4e63-bee7-efcbf572c4c1 req-2956f272-069c-4593-82ef-2ef6f21fd26a tempest-ImagesNegativeTestJSON-1490790654 tempest-ImagesNegativeTestJSON-1490790654-project-member] Enqueued Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_members [ 856.825450] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_members [ 856.825450] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.825450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.825450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.826063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.826343] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.826589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 856.826729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.829075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 856.830951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 856.831298] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.835699] env[62815]: INFO networking_nsxv3.common.synchronization [req-58d58e0f-eb1a-4249-a53b-91c1fb3ba51c req-85cefc55-12d7-43cd-9bd0-30aee939a249 tempest-ListServersNegativeTestJSON-1738427851 tempest-ListServersNegativeTestJSON-1738427851-project-member] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 856.835699] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGHEST for action security_group_members [ 856.835699] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.835699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.227086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.227453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.227453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.227547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.231169] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.249866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.249866] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.249982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.250028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.250276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.250359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.250402] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 857.280492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.280690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.280690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.280869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.281042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.288246] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 857.337059] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.337228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.337954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.337954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.337954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.337954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.337954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.337954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.338238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.338238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.338314] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 already deleted. [ 857.338353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.519821] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 857.520114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.568356] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.568446] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-791" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.568585] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-791" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.568979] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-791" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.569418] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.569528] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.569616] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.569846] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.569999] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.570408] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.570564] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.570711] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.570852] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.571065] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.571246] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.571512] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.590679] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.590910] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.591358] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.591652] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-791" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.592126] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-698931f2-f2c1-4f5b-8715-2b9e207ad631 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.592394] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.592577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.593045] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.593266] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('698931f2-f2c1-4f5b-8715-2b9e207ad631',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.734220] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.096406] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.096406] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.096628] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.096962] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.097150] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.097315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 698931f2-f2c1-4f5b-8715-2b9e207ad631 not found, creating... [ 858.097594] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.097926] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.097926] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.098152] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.098304] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.098588] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.098749] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.098887] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.099182] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.099327] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.099471] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 698931f2-f2c1-4f5b-8715-2b9e207ad631 is going to be created. [ 858.119429] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.119649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.119782] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.120065] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.120428] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.120650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.237780] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.237966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.237966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.238186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.238280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.238380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 858.270835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.271117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.271242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.271542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.271767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.281165] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 858.872856] env[62815]: INFO networking_nsxv3.common.synchronization [req-8c2c41b2-a778-4e63-bee7-efcbf572c4c1 req-f5a6dd77-5e80-4126-98d7-82ad5ee0ea7d service nova] Enqueued Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_rules [ 858.872856] env[62815]: INFO networking_nsxv3.common.synchronization [req-8c2c41b2-a778-4e63-bee7-efcbf572c4c1 req-f5a6dd77-5e80-4126-98d7-82ad5ee0ea7d service nova] Enqueued Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_members [ 858.873189] env[62815]: INFO networking_nsxv3.common.synchronization [req-8c2c41b2-a778-4e63-bee7-efcbf572c4c1 req-f5a6dd77-5e80-4126-98d7-82ad5ee0ea7d service nova] Enqueued Resource ID: 698931f2-f2c1-4f5b-8715-2b9e207ad631 with Priority: HIGHEST for action port [ 858.873488] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_rules [ 858.873643] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_members [ 858.873733] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698931f2-f2c1-4f5b-8715-2b9e207ad631 with Priority: HIGHEST for action port [ 858.877701] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.877701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.877701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.877701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.877701] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.880920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.880920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.880920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.880920] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.883258] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-698931f2-f2c1-4f5b-8715-2b9e207ad631 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.883739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.883739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.883994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.884174] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('698931f2-f2c1-4f5b-8715-2b9e207ad631',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.298513] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 859.298747] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 859.298840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.383839] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.386273] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 698931f2-f2c1-4f5b-8715-2b9e207ad631 with status ACTIVE [ 859.386584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.386721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.386818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.387088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.387191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.387433] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.387544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.387641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.387850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.387972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.388214] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.388332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.388427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.388584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.388674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.388785] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 698931f2-f2c1-4f5b-8715-2b9e207ad631 is going to be updated. [ 859.390639] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.390755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.409476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.409661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.409705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.409977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.410085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.410221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-698931f2-f2c1-4f5b-8715-2b9e207ad631" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.887372] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.085190] env[62815]: INFO networking_nsxv3.common.synchronization [req-ad88568b-f453-49ff-b6c5-9849fc984598 req-ec37830d-7cf2-43d3-bf76-ef8aa329b7e7 tempest-MigrationsAdminTest-121633230 tempest-MigrationsAdminTest-121633230-project-member] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 860.085719] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGHEST for action security_group_members [ 860.086036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.086161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.086229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.086741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.086937] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.087112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.087217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.087477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.087693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.088232] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.290990] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 860.291222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.291395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.291606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.291787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.291898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.291960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.292145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.292225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.292317] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.389979] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.392315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.392315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.392315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.392315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.392315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 is going to be created. [ 860.414841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.414998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.415077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.415299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.415461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.427264] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 in Status: UNINITIALIZED for 2s [ 860.590459] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.590459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.590459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.590626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.611165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.611424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.611539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.611612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.611800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.611931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.611989] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be updated. [ 860.637888] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.638082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.638159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.638375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.638516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.646664] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: IN_PROGRESS for 2s [ 860.794688] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.794829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.794902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.795172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.815939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.816338] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.816470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.816538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.816741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.816825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.816913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be updated. [ 860.839796] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.839961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.840048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.840324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.840493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.848337] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: IN_PROGRESS for 2s [ 862.439109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 in Status: SUCCESS [ 862.439484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.439623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.439743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.439937] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.440065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.440154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.440317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.440397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.440482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.440572] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.657730] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b036f05a-9535-4198-b6ab-eff3bdc28054 in Status: SUCCESS [ 862.657867] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 deletion is rescheduled due to dependency. [ 862.657984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.859228] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19461cde-6801-4c12-a058-618f670ad0d7 in Status: SUCCESS [ 862.860522] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 deletion is rescheduled due to dependency. [ 862.861089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.942750] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.943214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.943214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.943214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.943463] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.943551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.943581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.943737] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.943824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.943914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.944085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.944212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.944531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.944531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.944669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.944669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.944770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.944858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.944932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.945020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.945197] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.448432] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7396d6d-5d17-4765-b37a-cf2ed49220a2: rpc.has_security_group_logging(os_id): False [ 863.465488] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.465659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.465703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.466666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.466666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.466666] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.466666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.466666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.466666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.466666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.467111] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.467111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.467111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.467111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.467111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.467272] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.467933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.467933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.467933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.467933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.467933] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 is going to be created. [ 863.522620] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.522620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.522620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.523109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.523109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.538850] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 in Status: IN_PROGRESS for 2s [ 864.238418] env[62815]: INFO networking_nsxv3.common.synchronization [req-7b31380a-23b0-450f-b828-fbbbcf363e35 req-84897a52-c90e-450f-8293-d6e96f987e40 tempest-ServersTestManualDisk-455940675 tempest-ServersTestManualDisk-455940675-project-member] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_members [ 864.238720] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGHEST for action security_group_members [ 864.242626] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.242626] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.242626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.242626] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.746765] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.747060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.747060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.747496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.767406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.767901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.768103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.768249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.768456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.768574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.768694] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 is going to be updated. [ 864.793885] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.794562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.794562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.795388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.795388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.801872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: IN_PROGRESS for 2s [ 865.504602] env[62815]: INFO networking_nsxv3.common.synchronization [req-1aa370b2-421b-49a5-b7b0-99f3a9d8bf48 req-dee01ee1-2215-4faf-8c75-293364f27758 tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 865.505160] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 865.505471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.505598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.505671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.505850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.506013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.506579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.506657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.506809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.506900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.506994] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.550677] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 in Status: SUCCESS [ 865.550677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.010025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.353345] env[62815]: INFO networking_nsxv3.common.synchronization [req-c55d01a3-87d1-4fcd-8e80-a89716f77c49 req-5d2fa5e9-bb1b-4bf1-8249-489113108a13 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 866.353925] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 866.354263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.354386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.354454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.354668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.354822] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.354916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 866.354978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.355149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 866.355238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.355329] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.516441] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.811822] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 in Status: SUCCESS [ 866.813256] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 deletion is rescheduled due to dependency. [ 866.813485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 866.858426] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.022097] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.022325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.022389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.022611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.022703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.022856] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 867.050876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.051053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.051116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.054183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.054371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.062814] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 867.190121] env[62815]: INFO networking_nsxv3.common.synchronization [None req-0218652d-a071-4dee-879d-c8322a3bdbf4 None None] Enqueued Resource ID: 16d02491-865a-4f94-8f71-96614ba18f12 with Priority: HIGHEST for action port [ 867.190624] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d02491-865a-4f94-8f71-96614ba18f12 with Priority: HIGHEST for action port [ 867.192138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-16d02491-865a-4f94-8f71-96614ba18f12 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.192501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16d02491-865a-4f94-8f71-96614ba18f12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.192659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16d02491-865a-4f94-8f71-96614ba18f12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.193011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16d02491-865a-4f94-8f71-96614ba18f12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.193182] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16d02491-865a-4f94-8f71-96614ba18f12',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.297681] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.297681] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.297828] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.298080] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.298367] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.298511] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.298691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.298874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.301784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.303197] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.304464] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.304464] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.304464] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.304464] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.304464] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.304735] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.323865] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.324063] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.324209] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.324386] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.324698] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-0f9c1e0c-39ee-4655-9daf-f749272b7999 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.324896] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.324984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.325326] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.325477] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9c1e0c-39ee-4655-9daf-f749272b7999',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.362045] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.696771] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16d02491-865a-4f94-8f71-96614ba18f12 [ 867.697046] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.697215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.697285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.697609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.697609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.697723] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16d02491-865a-4f94-8f71-96614ba18f12 already deleted. [ 867.697802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16d02491-865a-4f94-8f71-96614ba18f12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.828018] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.828276] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.828420] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.828723] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.828879] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.829173] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 0f9c1e0c-39ee-4655-9daf-f749272b7999 not found, creating... [ 867.829473] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.829642] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.829767] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.830023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.830161] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.830453] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.830613] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.830736] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.830950] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.831259] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.831423] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 0f9c1e0c-39ee-4655-9daf-f749272b7999 is going to be created. [ 867.851737] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.851737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.851737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.852034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.852167] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.852434] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.864761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.864761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.864761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.864985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.865048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.865224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 867.892342] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.892494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 867.892881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.892881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 867.892991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 867.901170] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 868.679081] env[62815]: INFO networking_nsxv3.common.synchronization [req-c55d01a3-87d1-4fcd-8e80-a89716f77c49 req-5420717f-c645-4d20-9df6-ffb0d9a1444a service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 868.679081] env[62815]: INFO networking_nsxv3.common.synchronization [req-c55d01a3-87d1-4fcd-8e80-a89716f77c49 req-5420717f-c645-4d20-9df6-ffb0d9a1444a service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 868.679081] env[62815]: INFO networking_nsxv3.common.synchronization [req-c55d01a3-87d1-4fcd-8e80-a89716f77c49 req-5420717f-c645-4d20-9df6-ffb0d9a1444a service nova] Enqueued Resource ID: 0f9c1e0c-39ee-4655-9daf-f749272b7999 with Priority: HIGHEST for action port [ 868.679081] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 868.679457] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 868.679457] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9c1e0c-39ee-4655-9daf-f749272b7999 with Priority: HIGHEST for action port [ 868.681957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.681957] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.681957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.681957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9c1e0c-39ee-4655-9daf-f749272b7999 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.681957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.681957] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9c1e0c-39ee-4655-9daf-f749272b7999',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.073495] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 869.073785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.183987] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.184249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.186524] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f9c1e0c-39ee-4655-9daf-f749272b7999 with status ACTIVE [ 869.186712] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.186832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.186899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.187225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.187225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.187374] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.187464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.187548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.187698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.187779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.187964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.188064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.188118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.189200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.189200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.189200] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f9c1e0c-39ee-4655-9daf-f749272b7999 is going to be updated. [ 869.212501] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.212677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.212714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.212914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.213066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.213245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9c1e0c-39ee-4655-9daf-f749272b7999" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.523759] env[62815]: INFO networking_nsxv3.common.synchronization [None req-0cde3908-d02f-442f-b507-8da9c8cb35b7 None None] Enqueued Resource ID: 95e81295-8f60-4ac2-8d07-e7df5eeebf42 with Priority: HIGHEST for action port [ 869.524398] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e81295-8f60-4ac2-8d07-e7df5eeebf42 with Priority: HIGHEST for action port [ 869.524715] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-95e81295-8f60-4ac2-8d07-e7df5eeebf42 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.524838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95e81295-8f60-4ac2-8d07-e7df5eeebf42" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.524908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95e81295-8f60-4ac2-8d07-e7df5eeebf42" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.525185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95e81295-8f60-4ac2-8d07-e7df5eeebf42" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.525268] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95e81295-8f60-4ac2-8d07-e7df5eeebf42',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.910437] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 869.910754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.910824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.911148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.911409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.911558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 869.911639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.911797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 869.911882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 869.911979] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.027517] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95e81295-8f60-4ac2-8d07-e7df5eeebf42 [ 870.027745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.027877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.027945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.028183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.028273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.028372] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95e81295-8f60-4ac2-8d07-e7df5eeebf42 already deleted. [ 870.028452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95e81295-8f60-4ac2-8d07-e7df5eeebf42" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.416394] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.726778] env[62815]: INFO networking_nsxv3.common.synchronization [req-c6999e23-3892-4466-8097-4ffeb6f10ec1 req-7002f43d-d944-4443-985a-b09643306b5e tempest-ImagesNegativeTestJSON-1490790654 tempest-ImagesNegativeTestJSON-1490790654-project-member] Enqueued Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_members [ 870.730051] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGHEST for action security_group_members [ 870.730051] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.730051] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.730051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.730620] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.919439] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.236301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.236301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.236301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.236301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.236301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.236301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.236301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.236301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.236672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.236672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.236672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 is going to be updated. [ 871.261721] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.261901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.261934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.262178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.262646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.272312] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 in Status: IN_PROGRESS for 2s [ 871.422623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.422623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.422623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.422823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.422903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.423093] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 871.454586] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.454754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.454826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.455090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.455235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.464017] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 873.283562] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 in Status: SUCCESS [ 873.283882] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 deletion is rescheduled due to dependency. [ 873.283882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.474270] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 873.474530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.474709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.474929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.475133] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.475252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.475319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.475468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.475564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.475659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.475751] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.978266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.978514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.978514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.978792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.978986] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.979124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.979183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.979303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.979394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.979482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.979625] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.979708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.979762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.979899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.980043] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.980134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 873.980191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.980334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 873.980429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.980529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 873.980625] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.482724] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 874.502233] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.502233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.502233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.502233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.522693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.522933] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.523063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.523119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.523310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.523408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.523616] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.523714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.523770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.523916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.523989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.524196] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.524290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.524351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.524488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.524561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.524642] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 874.580180] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.580327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 874.580386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.580572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 874.580710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 874.590827] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 875.728856] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 875.728856] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 876.183028] env[62815]: INFO networking_nsxv3.common.synchronization [req-0738338d-6fe4-44e1-8edf-c5cce7c0f2cc req-cb949372-3952-4882-8c44-ff9aa463504d tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_members [ 876.183028] env[62815]: INFO networking_nsxv3.common.synchronization [req-0738338d-6fe4-44e1-8edf-c5cce7c0f2cc req-cb949372-3952-4882-8c44-ff9aa463504d tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 876.183028] env[62815]: INFO networking_nsxv3.common.synchronization [req-0738338d-6fe4-44e1-8edf-c5cce7c0f2cc req-cb949372-3952-4882-8c44-ff9aa463504d tempest-SecurityGroupsTestJSON-1505598694 tempest-SecurityGroupsTestJSON-1505598694-project-member] Enqueued Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 876.183603] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGHEST for action security_group_members [ 876.184040] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faad13ba-ac02-4335-855b-47b1737205ca with Priority: HIGHEST for action security_group_members [ 876.186425] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b with Priority: HIGHEST for action security_group_members [ 876.186425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.186425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.186425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.186425] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.186975] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-faad13ba-ac02-4335-855b-47b1737205ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.187782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.187952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.188175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.188386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.188712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.188712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.188848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.189042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.189199] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faad13ba-ac02-4335-855b-47b1737205ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.190131] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6d0cd-3c56-42cd-8d37-8158526e935b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.190295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.190397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.190632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.190858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.191087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.191252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.191444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.191573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.191700] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6d0cd-3c56-42cd-8d37-8158526e935b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.604516] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 876.604841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.693586] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.693744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.693813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.694052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.695239] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.695352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.695644] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.695765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.715164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.715164] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.715164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.715164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.715164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.715432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.715432] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faad13ba-ac02-4335-855b-47b1737205ca is going to be updated. [ 876.716818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.716818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.733660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.733918] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.734038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.734102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.734291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.734372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.734463] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 is going to be updated. [ 876.735351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.735519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.735605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.735784] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.735884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.735948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.736250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.736335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.736511] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b is going to be updated. [ 876.740265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.740435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.740532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.740884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.740884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.749380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: IN_PROGRESS for 2s [ 876.766028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.766028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.766028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.766028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.766028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.768242] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.768896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 876.769167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.769520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 876.769800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 876.778355] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: IN_PROGRESS for 2s [ 876.779497] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: IN_PROGRESS for 2s [ 877.917166] env[62815]: INFO networking_nsxv3.common.synchronization [None req-3fa653d8-9505-472e-ad99-ff71baee2f92 None None] Enqueued Resource ID: 9ae6b2d2-106f-48a4-8c49-f0bde1680d45 with Priority: HIGHEST for action port [ 877.917470] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae6b2d2-106f-48a4-8c49-f0bde1680d45 with Priority: HIGHEST for action port [ 877.918078] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae6b2d2-106f-48a4-8c49-f0bde1680d45 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.918230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae6b2d2-106f-48a4-8c49-f0bde1680d45" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.918322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae6b2d2-106f-48a4-8c49-f0bde1680d45" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.918656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae6b2d2-106f-48a4-8c49-f0bde1680d45" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.918736] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae6b2d2-106f-48a4-8c49-f0bde1680d45',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.420506] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ae6b2d2-106f-48a4-8c49-f0bde1680d45 [ 878.420769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.421044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.421206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.421445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.421556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.421672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ae6b2d2-106f-48a4-8c49-f0bde1680d45 already deleted. [ 878.421778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae6b2d2-106f-48a4-8c49-f0bde1680d45" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.763671] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faad13ba-ac02-4335-855b-47b1737205ca in Status: SUCCESS [ 878.763671] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faad13ba-ac02-4335-855b-47b1737205ca deletion is rescheduled due to dependency. [ 878.763671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faad13ba-ac02-4335-855b-47b1737205ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.789713] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b in Status: SUCCESS [ 878.789713] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6d0cd-3c56-42cd-8d37-8158526e935b deletion is rescheduled due to dependency. [ 878.789713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6d0cd-3c56-42cd-8d37-8158526e935b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.793732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 in Status: SUCCESS [ 878.793732] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 deletion is rescheduled due to dependency. [ 878.793732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.138639] env[62815]: INFO networking_nsxv3.common.synchronization [req-f9952733-49cc-41bc-b055-716523a5e0eb req-64cfe80c-3f97-4abd-9333-1a5905e9ab5d tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 880.138639] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 880.139814] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.139814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.139814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.141851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.142621] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.142621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.142621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.142621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.142621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.142621] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.358860] env[62815]: INFO networking_nsxv3.common.synchronization [None req-63aa47b9-791f-455d-aae1-6a822aed1f3e None None] Enqueued Resource ID: 5a2ed079-2f70-45c6-987c-69d28efc6920 with Priority: HIGHEST for action port [ 880.358860] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2ed079-2f70-45c6-987c-69d28efc6920 with Priority: HIGHEST for action port [ 880.359524] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a2ed079-2f70-45c6-987c-69d28efc6920 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.359524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a2ed079-2f70-45c6-987c-69d28efc6920" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.359671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a2ed079-2f70-45c6-987c-69d28efc6920" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.359828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a2ed079-2f70-45c6-987c-69d28efc6920" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.360565] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a2ed079-2f70-45c6-987c-69d28efc6920',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.493057] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.493293] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.493458] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.493882] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.494096] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.494288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.495359] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.496085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.496321] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.496573] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.496718] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.496868] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.496993] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.497135] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.498099] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.498457] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.518288] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.518288] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 880.518288] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.518288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.518288] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.518288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.518288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.518288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.518288] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d09858f0-59a5-4423-b9c8-6e514bb4a1d6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.644679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.644868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.644999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.645245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.645422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.645662] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.645766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.645828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.645987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.646076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.646201] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 880.673335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.673508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.673564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.673771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.673906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.683112] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 880.862620] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a2ed079-2f70-45c6-987c-69d28efc6920 [ 880.862877] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.863704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.863704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.863704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.863704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.863704] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a2ed079-2f70-45c6-987c-69d28efc6920 already deleted. [ 880.863704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a2ed079-2f70-45c6-987c-69d28efc6920" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.022027] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.022027] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.022286] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.022733] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.022794] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.023028] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port d09858f0-59a5-4423-b9c8-6e514bb4a1d6 not found, creating... [ 881.023448] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.023948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.024101] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.024438] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.024668] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.025241] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.025388] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.025563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.025846] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.026054] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.026391] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: d09858f0-59a5-4423-b9c8-6e514bb4a1d6 is going to be created. [ 881.045616] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.046178] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.046466] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.046726] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.047049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.047449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.814627] env[62815]: INFO networking_nsxv3.common.synchronization [req-f9952733-49cc-41bc-b055-716523a5e0eb req-eba8c57a-9eb2-49e1-9b55-cd7df12088c8 service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 881.814627] env[62815]: INFO networking_nsxv3.common.synchronization [req-f9952733-49cc-41bc-b055-716523a5e0eb req-eba8c57a-9eb2-49e1-9b55-cd7df12088c8 service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 881.814627] env[62815]: INFO networking_nsxv3.common.synchronization [req-f9952733-49cc-41bc-b055-716523a5e0eb req-eba8c57a-9eb2-49e1-9b55-cd7df12088c8 service nova] Enqueued Resource ID: d09858f0-59a5-4423-b9c8-6e514bb4a1d6 with Priority: HIGHEST for action port [ 881.814627] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 881.814627] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 881.814627] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09858f0-59a5-4423-b9c8-6e514bb4a1d6 with Priority: HIGHEST for action port [ 881.814627] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.814627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.815553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.815553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.815553] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.816886] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.817033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.817270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.817405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.818664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.818897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.818984] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d09858f0-59a5-4423-b9c8-6e514bb4a1d6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.318348] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.318348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.322405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d09858f0-59a5-4423-b9c8-6e514bb4a1d6 with status ACTIVE [ 882.323030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.323030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.323030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.323250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.323295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.323459] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.323572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.323659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.323852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.323956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.324215] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.324327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.324399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.324567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.324641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.324727] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d09858f0-59a5-4423-b9c8-6e514bb4a1d6 is going to be updated. [ 882.344397] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.344548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.344620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.344868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.345026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.345191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d09858f0-59a5-4423-b9c8-6e514bb4a1d6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.693146] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 882.693361] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 882.693518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.693717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.693958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.694190] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.694330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.694392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.694601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.694712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.694823] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.197018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.699393] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.202647] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.202937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.202937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.203100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.203193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.203294] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 884.243939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.243939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.243939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.243939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.243939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.252513] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 886.264625] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 886.265061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.265202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.265416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.265671] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.265824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.265898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.266098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.266193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.266321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.266427] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.769208] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.769375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.769414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.769741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.770614] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.770834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.770946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.771234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.771378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.771532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.771780] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.771940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.772055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.772291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.772537] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.772695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 886.772820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.773065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 886.773208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.773317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 886.773412] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.814884] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 886.815099] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 887.275747] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95315c29-36f4-4fb3-afae-f96b062c5650: rpc.has_security_group_logging(os_id): False [ 887.293963] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.293963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.293963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.293963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.293963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.295339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.295339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.295339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.295517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.295585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.295759] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.295857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.295920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.300021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.300021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.300021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.300021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.300021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.300021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.300021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.300021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 887.355169] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.355336] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 887.355382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.355593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 887.355731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 887.368249] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 889.390115] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 889.390471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.339911] env[62815]: INFO networking_nsxv3.common.synchronization [None req-519920e6-5706-4c45-b08d-46f0ba8a0354 None None] Enqueued Resource ID: 86d60b78-cbc8-46b7-bbf7-01dcbee2853d with Priority: HIGHEST for action port [ 891.341829] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86d60b78-cbc8-46b7-bbf7-01dcbee2853d with Priority: HIGHEST for action port [ 891.342105] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-86d60b78-cbc8-46b7-bbf7-01dcbee2853d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.342234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86d60b78-cbc8-46b7-bbf7-01dcbee2853d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.342325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86d60b78-cbc8-46b7-bbf7-01dcbee2853d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.342562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86d60b78-cbc8-46b7-bbf7-01dcbee2853d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.342644] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d60b78-cbc8-46b7-bbf7-01dcbee2853d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.846106] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86d60b78-cbc8-46b7-bbf7-01dcbee2853d [ 891.846106] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.846106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.846106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.846106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.846106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.846106] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86d60b78-cbc8-46b7-bbf7-01dcbee2853d already deleted. [ 891.846106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86d60b78-cbc8-46b7-bbf7-01dcbee2853d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.309139] env[62815]: INFO networking_nsxv3.common.synchronization [None req-b64b122c-6d82-4850-95e9-1ac066dfe176 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_rules [ 892.309139] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_rules [ 892.310275] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.310275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.310275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.313020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.313020] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.393094] env[62815]: INFO networking_nsxv3.common.synchronization [None req-b99e7604-a540-4542-af74-cb572957d73f tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_rules [ 892.393661] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_rules [ 892.393970] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.394085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.834306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.834438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.835486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.835486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.835486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.835486] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da already deleted. [ 892.835486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.835486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.835486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.835486] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.356392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.356586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.356650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.356868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.356959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.357077] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da already deleted. [ 893.357163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.624489] env[62815]: INFO networking_nsxv3.common.synchronization [req-21621fe3-8c5c-40c3-b507-7a0d39b29439 req-e5038e83-55af-45e8-a73e-2ebd6a1e837f tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 893.625044] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 893.625360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.625502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.625540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.625745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.625938] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.626559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.626671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.626846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.626938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.627042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.762008] env[62815]: INFO networking_nsxv3.common.synchronization [None req-1742b091-4953-4d73-8275-1b045cca1644 None None] Enqueued Resource ID: 33d71cbb-b7dd-4cb6-bb1f-d782d43810e3 with Priority: HIGHEST for action port [ 893.762274] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d71cbb-b7dd-4cb6-bb1f-d782d43810e3 with Priority: HIGHEST for action port [ 893.762920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-33d71cbb-b7dd-4cb6-bb1f-d782d43810e3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.762985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33d71cbb-b7dd-4cb6-bb1f-d782d43810e3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.765861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33d71cbb-b7dd-4cb6-bb1f-d782d43810e3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.766272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33d71cbb-b7dd-4cb6-bb1f-d782d43810e3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.766370] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33d71cbb-b7dd-4cb6-bb1f-d782d43810e3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.129520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.129681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.129752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.129968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.130074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.130905] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.131065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.131136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.131353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.131445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.131520] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be deleted. [ 894.165474] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.166526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.166526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.166526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.166526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.166526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.219953] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.220186] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.220334] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.220610] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.220893] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.221067] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.221223] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.221449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.221607] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.221819] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.221943] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.222069] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.222184] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.222341] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.222468] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.222605] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.241019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.241224] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.241376] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.241562] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.241869] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-44d62ddb-1441-4f89-85db-e18759fd3dea taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.242077] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.242221] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.242604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.242756] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d62ddb-1441-4f89-85db-e18759fd3dea',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.268620] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33d71cbb-b7dd-4cb6-bb1f-d782d43810e3 [ 894.268845] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.268970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.269046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.269260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.269351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.269436] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33d71cbb-b7dd-4cb6-bb1f-d782d43810e3 already deleted. [ 894.269513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33d71cbb-b7dd-4cb6-bb1f-d782d43810e3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.745187] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.745494] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.745579] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.745837] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.745994] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.746170] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 44d62ddb-1441-4f89-85db-e18759fd3dea not found, creating... [ 894.746436] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.746599] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.746721] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.746945] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.747215] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.747511] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.747674] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.747795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.748020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.748157] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.748301] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 44d62ddb-1441-4f89-85db-e18759fd3dea is going to be created. [ 894.769433] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.769692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.769793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.770029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.770265] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.770485] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.499430] env[62815]: INFO networking_nsxv3.common.synchronization [req-21621fe3-8c5c-40c3-b507-7a0d39b29439 req-7a064b2e-69da-4993-91ac-abebed04553c service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 895.499623] env[62815]: INFO networking_nsxv3.common.synchronization [req-21621fe3-8c5c-40c3-b507-7a0d39b29439 req-7a064b2e-69da-4993-91ac-abebed04553c service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 895.499770] env[62815]: INFO networking_nsxv3.common.synchronization [req-21621fe3-8c5c-40c3-b507-7a0d39b29439 req-7a064b2e-69da-4993-91ac-abebed04553c service nova] Enqueued Resource ID: 44d62ddb-1441-4f89-85db-e18759fd3dea with Priority: HIGHEST for action port [ 895.500037] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 895.500151] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 895.500251] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44d62ddb-1441-4f89-85db-e18759fd3dea with Priority: HIGHEST for action port [ 895.500912] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.500990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.501817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.502210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.502266] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.504639] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.504937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.504937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.505354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.505391] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.505521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.505612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.505944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.505944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.506121] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.507641] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-44d62ddb-1441-4f89-85db-e18759fd3dea taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.507788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.507882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.508095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.508203] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d62ddb-1441-4f89-85db-e18759fd3dea',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.004551] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.004883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.010179] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44d62ddb-1441-4f89-85db-e18759fd3dea with status ACTIVE [ 896.010806] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.010806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.010806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.010806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.011342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.011342] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.011342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.011342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.011477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.011511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.011675] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.011765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.011825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.011962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.012066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.012127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44d62ddb-1441-4f89-85db-e18759fd3dea is going to be updated. [ 896.014636] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.033701] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.034328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 896.034328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.034328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 896.034328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.034507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44d62ddb-1441-4f89-85db-e18759fd3dea" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 896.515419] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.022717] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.023067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.023259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.025157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.025267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.026143] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be created. [ 897.047093] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.047376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 897.047376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.047515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 897.047904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 897.055931] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: UNINITIALIZED for 2s [ 898.758822] env[62815]: INFO networking_nsxv3.common.synchronization [req-44e38518-4b49-4a6a-8922-eca8a8dbbb8f req-12903583-4794-437e-a628-c107061450b4 tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 898.759408] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 898.759725] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.759850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.759935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.760175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.760346] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.760662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 898.760662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.760662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 898.760759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 898.761289] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.066641] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 899.066922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.067575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.067847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.069618] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.069618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.069618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.069618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.069618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.069618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.069618] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.264307] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.460809] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7e09ca9-e280-4f8b-8bbe-606d542cbc99 req-bea8050a-2364-4e7c-a9d0-fea3c631fcb8 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 899.460809] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 899.460809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.460809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.460809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.460809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.460809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.460809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.461205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.461416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.461546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.461668] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.572915] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.573078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.573195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.573442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.574188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.574188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.574188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.576014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.576014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.576014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.576216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.576391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.576391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.576588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.576763] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.576941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.576941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.577175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.577346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.577458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.577582] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.770431] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.874626] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.874879] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.875038] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.875331] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.875599] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.875758] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.875876] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.876319] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.876508] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.876779] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.876932] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.877076] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.877216] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.877356] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.877500] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.877702] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.897034] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.897034] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.897034] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.897210] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.897525] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-eeac7376-40e8-4275-8982-7812a00ce8df taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.897723] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.897854] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.899029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.899029] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeac7376-40e8-4275-8982-7812a00ce8df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.964029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.964225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.964614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.964614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.964724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.964915] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.965058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 899.965150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.965390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 899.965513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 899.965626] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 already deleted. [ 899.965736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.080529] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d6bbb76-6d82-445e-a124-2538b600ecb4: rpc.has_security_group_logging(os_id): False [ 900.100566] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.100714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.100784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.100973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.101088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.101324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.101423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.101485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.101847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.101922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.102126] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.102218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.102277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.102430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.102505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.102718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.102834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.102897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.103168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.103261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.103349] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be created. [ 900.157901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.158065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.158116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.158392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.158601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.168312] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 900.270233] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.270233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.270233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.271024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.271138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.271300] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 900.305241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.305419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.305521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.305778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.306072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.314819] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 900.402173] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.402569] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.406330] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port eeac7376-40e8-4275-8982-7812a00ce8df not found, creating... [ 900.406330] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.406330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.406330] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.406962] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.406962] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.407389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.407691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.408014] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: eeac7376-40e8-4275-8982-7812a00ce8df is going to be created. [ 900.430035] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.430035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.430035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.430035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.430035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.430035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.980403] env[62815]: INFO networking_nsxv3.common.synchronization [None req-63ea2ead-c679-47a4-880c-1bf276a73224 None None] Enqueued Resource ID: 666fc8c1-c61b-4eef-8975-96c88d43e20b with Priority: HIGHEST for action port [ 900.980730] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 666fc8c1-c61b-4eef-8975-96c88d43e20b with Priority: HIGHEST for action port [ 900.981309] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-666fc8c1-c61b-4eef-8975-96c88d43e20b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.981639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-666fc8c1-c61b-4eef-8975-96c88d43e20b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 900.981639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-666fc8c1-c61b-4eef-8975-96c88d43e20b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.981778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-666fc8c1-c61b-4eef-8975-96c88d43e20b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 900.981860] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('666fc8c1-c61b-4eef-8975-96c88d43e20b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.079855] env[62815]: INFO networking_nsxv3.common.synchronization [None req-6ca0fbf0-458a-40f3-8d4b-68bb6bb08178 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 901.080427] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 901.080733] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.080855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.080922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.081314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.081668] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.081879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.082026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.082326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.082515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.082703] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.230191] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7e09ca9-e280-4f8b-8bbe-606d542cbc99 req-e17b16fa-1563-4fec-8c3c-2fb8578c4207 service nova] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_rules [ 901.230191] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7e09ca9-e280-4f8b-8bbe-606d542cbc99 req-e17b16fa-1563-4fec-8c3c-2fb8578c4207 service nova] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 901.230191] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7e09ca9-e280-4f8b-8bbe-606d542cbc99 req-e17b16fa-1563-4fec-8c3c-2fb8578c4207 service nova] Enqueued Resource ID: eeac7376-40e8-4275-8982-7812a00ce8df with Priority: HIGHEST for action port [ 901.230191] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_rules [ 901.230191] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 901.230191] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeac7376-40e8-4275-8982-7812a00ce8df with Priority: HIGHEST for action port [ 901.230191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.230191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.230191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.230191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.232562] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.233515] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.233678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.234065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.234065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.234197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.234258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.234301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.234440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.234527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.234634] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.235600] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeac7376-40e8-4275-8982-7812a00ce8df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.235716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.235785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.235962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.236051] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeac7376-40e8-4275-8982-7812a00ce8df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.485085] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 666fc8c1-c61b-4eef-8975-96c88d43e20b [ 901.485085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.485085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.485085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.485360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.485360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.485447] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:666fc8c1-c61b-4eef-8975-96c88d43e20b already deleted. [ 901.485528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-666fc8c1-c61b-4eef-8975-96c88d43e20b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.585099] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.738946] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.739116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.739340] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.740827] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeac7376-40e8-4275-8982-7812a00ce8df with status ACTIVE [ 901.741031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.741298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.741364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.741631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.741671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.741858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.741966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.742043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.742202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.742309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.742522] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.742629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.742692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.742840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.742917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.743015] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeac7376-40e8-4275-8982-7812a00ce8df is going to be updated. [ 901.765162] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.765310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.765379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.765611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.765749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.765902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeac7376-40e8-4275-8982-7812a00ce8df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.902029] env[62815]: INFO networking_nsxv3.common.synchronization [req-bc127503-6e3d-42de-a3ad-b09730a4bd3f req-b2b826a9-2ff9-4b4e-9a22-f61fc67dcb52 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 901.902139] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 901.902409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.902521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.902589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.902786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.902937] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.903342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 901.903342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.903499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 901.904587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 901.904587] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.088926] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.154245] env[62815]: INFO networking_nsxv3.common.synchronization [req-2fb53c68-1abc-45cb-a6b6-f36914b851f5 req-663a4d36-b938-4587-a23a-83394b9f6342 tempest-InstanceActionsTestJSON-2053809201 tempest-InstanceActionsTestJSON-2053809201-project-member] Enqueued Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_members [ 902.160680] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_members [ 902.160991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.161166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.161249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.161568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.162113] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.162222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.162288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.162454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.162540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.162636] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.180561] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 902.180745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.243411] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.329091] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 902.329331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.406619] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.406802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.406873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.407374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.427486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.427737] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.428870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.428870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.428870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.428870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.428870] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 902.454178] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.454469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.454469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.455617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.455617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.462518] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 902.592390] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.592580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.592648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.592871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.592965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.593073] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 902.626831] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.626987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.627058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.627351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.627664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.642616] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 902.665651] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.665651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.667105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.667105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.671987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.671987] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.671987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.671987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.671987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.671987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.671987] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 already deleted. [ 902.671987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.745512] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.745750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.745834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.746118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.746245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.746380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be created. [ 902.767515] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.767661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.767698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.767963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.768201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.782098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: UNINITIALIZED for 2s [ 902.840013] env[62815]: INFO networking_nsxv3.common.synchronization [None req-98709cd6-8f20-40e5-9bd7-2cc0e9969d68 tempest-ServersV294TestFqdnHostnames-377829194 tempest-ServersV294TestFqdnHostnames-377829194-project-member] Enqueued Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_rules [ 902.840013] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_rules [ 902.841996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.841996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.841996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.841996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.841996] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.842362] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.842558] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.843165] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.843165] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.843332] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.843732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.843732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.843732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.843876] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.844562] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.844562] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.844562] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.844562] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.844562] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.844786] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.844786] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.863994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.864243] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.864392] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.864605] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 902.864960] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-01e2bc76-32da-4a31-b164-e12a01db6279 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.865195] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 902.865388] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.865826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 902.866057] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01e2bc76-32da-4a31-b164-e12a01db6279',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.954125] env[62815]: INFO networking_nsxv3.common.synchronization [None req-75e5eb53-2a47-4ec3-a2c3-364fb8ca46e8 tempest-ServersV294TestFqdnHostnames-377829194 tempest-ServersV294TestFqdnHostnames-377829194-project-member] Enqueued Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_rules [ 902.954753] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_rules [ 902.955142] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.955290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.366751] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.367187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.367187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.367307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.367307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.367405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd already deleted. [ 903.367504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.368422] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.368600] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.368746] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.369011] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.369170] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.369330] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 01e2bc76-32da-4a31-b164-e12a01db6279 not found, creating... [ 903.369614] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.369770] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.369908] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.370217] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.370389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.370673] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.370854] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.370974] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.371245] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.371418] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.371564] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 01e2bc76-32da-4a31-b164-e12a01db6279 is going to be created. [ 903.372705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.372867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.372952] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.389746] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.390328] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.390328] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.391092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.391092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.391850] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.690498] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.690693] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.690838] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.691155] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.691494] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.691649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.691779] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.694118] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.697614] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.697614] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.697614] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.697614] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.697614] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.697614] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.697614] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.697614] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.727951] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.728164] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.728312] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.728491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.728823] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-1b47b217-2a85-453f-a1c7-18543ea135c7 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.729009] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.729144] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.729513] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.729657] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b47b217-2a85-453f-a1c7-18543ea135c7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.794635] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a598e737-7ebb-4e87-97b9-7809f7fe208f None None] Enqueued Resource ID: 0a7609ad-9a72-4353-8c68-974bdbce26d0 with Priority: HIGHEST for action port [ 903.794913] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7609ad-9a72-4353-8c68-974bdbce26d0 with Priority: HIGHEST for action port [ 903.795500] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a7609ad-9a72-4353-8c68-974bdbce26d0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.795894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a7609ad-9a72-4353-8c68-974bdbce26d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.795894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a7609ad-9a72-4353-8c68-974bdbce26d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.796064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a7609ad-9a72-4353-8c68-974bdbce26d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.796373] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a7609ad-9a72-4353-8c68-974bdbce26d0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.895318] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.895318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 903.895318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.895318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 903.895318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 903.895318] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd already deleted. [ 903.895318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.235449] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.235797] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.235940] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.237282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.241061] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 1b47b217-2a85-453f-a1c7-18543ea135c7 not found, creating... [ 904.241061] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.241061] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.241061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.241553] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.241553] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.241553] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 1b47b217-2a85-453f-a1c7-18543ea135c7 is going to be created. [ 904.261862] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.261862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.261862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.261862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.261862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.262287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.298558] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a7609ad-9a72-4353-8c68-974bdbce26d0 [ 904.298804] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.298941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.299028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.299236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.299369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.299421] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a7609ad-9a72-4353-8c68-974bdbce26d0 already deleted. [ 904.299494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a7609ad-9a72-4353-8c68-974bdbce26d0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.471794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 904.472119] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 deletion is rescheduled due to dependency. [ 904.472119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.487934] env[62815]: INFO networking_nsxv3.common.synchronization [req-2fb53c68-1abc-45cb-a6b6-f36914b851f5 req-cb5c8c86-e349-4f8f-8c3d-36bfd8ea8066 service nova] Enqueued Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_rules [ 904.488142] env[62815]: INFO networking_nsxv3.common.synchronization [req-2fb53c68-1abc-45cb-a6b6-f36914b851f5 req-cb5c8c86-e349-4f8f-8c3d-36bfd8ea8066 service nova] Enqueued Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_members [ 904.488293] env[62815]: INFO networking_nsxv3.common.synchronization [req-2fb53c68-1abc-45cb-a6b6-f36914b851f5 req-cb5c8c86-e349-4f8f-8c3d-36bfd8ea8066 service nova] Enqueued Resource ID: 01e2bc76-32da-4a31-b164-e12a01db6279 with Priority: HIGHEST for action port [ 904.488540] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_rules [ 904.488674] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_members [ 904.488773] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01e2bc76-32da-4a31-b164-e12a01db6279 with Priority: HIGHEST for action port [ 904.489377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.489506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.489564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.489833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.489910] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.492363] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.492363] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.492363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.492363] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.493228] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-01e2bc76-32da-4a31-b164-e12a01db6279 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.493228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.493228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.493400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.493449] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01e2bc76-32da-4a31-b164-e12a01db6279',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.651213] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 904.651532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.792459] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 904.792688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.792879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.793116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.793310] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.793424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 904.793489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.793672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 904.793778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.793889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 904.793979] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.997368] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.998478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.001951] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.003471] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01e2bc76-32da-4a31-b164-e12a01db6279 with status ACTIVE [ 905.003786] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.004150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.004395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.004746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.004746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.004905] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.005087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.005087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.005392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.005488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.005799] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.005950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.006018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.006636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.006636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.006636] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01e2bc76-32da-4a31-b164-e12a01db6279 is going to be updated. [ 905.025527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.025671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.025782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.025942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.026854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.026854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01e2bc76-32da-4a31-b164-e12a01db6279" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.197234] env[62815]: INFO networking_nsxv3.common.synchronization [req-1f1b912b-d0aa-48bc-b277-715b7a70ffa0 req-e12c1583-5c77-4948-9a44-63bb915937f0 service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 905.197463] env[62815]: INFO networking_nsxv3.common.synchronization [req-1f1b912b-d0aa-48bc-b277-715b7a70ffa0 req-e12c1583-5c77-4948-9a44-63bb915937f0 service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 905.197571] env[62815]: INFO networking_nsxv3.common.synchronization [req-1f1b912b-d0aa-48bc-b277-715b7a70ffa0 req-e12c1583-5c77-4948-9a44-63bb915937f0 service nova] Enqueued Resource ID: 1b47b217-2a85-453f-a1c7-18543ea135c7 with Priority: HIGHEST for action port [ 905.197809] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 905.197936] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 905.198043] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b47b217-2a85-453f-a1c7-18543ea135c7 with Priority: HIGHEST for action port [ 905.198603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.199656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.199656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.199656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.199656] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.200260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.200260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.200260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.200379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.200427] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.200519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.200689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.200749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.200798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.200888] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.201658] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b47b217-2a85-453f-a1c7-18543ea135c7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.201784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.201840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.201954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.204272] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b47b217-2a85-453f-a1c7-18543ea135c7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.297998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.297998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.297998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.297998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.297998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.297998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.297998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.297998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.298406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.298406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.298406] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.298406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.298612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.298612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.299389] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.299389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.299389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.299389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.299389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.299389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.299389] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.504020] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.706727] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.707876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.708067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.712020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b47b217-2a85-453f-a1c7-18543ea135c7 with status ACTIVE [ 905.712020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.712020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.712020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.712020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.712680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.712680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.712680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.712680] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b47b217-2a85-453f-a1c7-18543ea135c7 is going to be updated. [ 905.735034] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.735034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.735034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.735034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.735034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.735034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b47b217-2a85-453f-a1c7-18543ea135c7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.803127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8d730a4-9510-494a-a33d-86b82a27d766: rpc.has_security_group_logging(os_id): False [ 905.826185] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.826378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.826426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.826616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.826713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.826924] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.827039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.827105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.827261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.827340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.827540] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.827636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.827734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.827868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.827924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.828094] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.828187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.828248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.828390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.828465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.828550] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be created. [ 905.888918] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.889218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 905.889218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.889403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 905.889570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 905.905840] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: IN_PROGRESS for 2s [ 906.006746] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.006926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.006980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.007222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.007316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.007420] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 is going to be created. [ 906.030987] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.031165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.031267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.031465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.031627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.041489] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 in Status: UNINITIALIZED for 2s [ 906.215532] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.723018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.723018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.723018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.727373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.727373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.727373] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 906.758415] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.758588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.758661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.758889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.758979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 906.774475] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 906.794206] env[62815]: INFO networking_nsxv3.common.synchronization [None req-39c1ddfc-6740-4ce0-a4c5-fe94f13f4f3e None None] Enqueued Resource ID: f7c2f6f1-aed3-4300-b01a-4dfe06d26212 with Priority: HIGHEST for action port [ 906.796170] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c2f6f1-aed3-4300-b01a-4dfe06d26212 with Priority: HIGHEST for action port [ 906.796170] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7c2f6f1-aed3-4300-b01a-4dfe06d26212 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.796170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7c2f6f1-aed3-4300-b01a-4dfe06d26212" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 906.796170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7c2f6f1-aed3-4300-b01a-4dfe06d26212" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.796170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7c2f6f1-aed3-4300-b01a-4dfe06d26212" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 906.796559] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7c2f6f1-aed3-4300-b01a-4dfe06d26212',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.299731] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7c2f6f1-aed3-4300-b01a-4dfe06d26212 [ 907.299973] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.300117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 907.300186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.300437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 907.300623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.300623] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7c2f6f1-aed3-4300-b01a-4dfe06d26212 already deleted. [ 907.300708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7c2f6f1-aed3-4300-b01a-4dfe06d26212" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 907.916903] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 907.916903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.051625] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 in Status: SUCCESS [ 908.051925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.051925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.052107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.052327] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.052477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.052549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.052734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.052823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.052914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.053040] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.555957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.556197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.556197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.556423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.556616] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.556730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.556830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.556952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.557061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.557149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.557303] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.557410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.557611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.557611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.557761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.557835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.557886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.558036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.558123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.558173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.558261] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.788139] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 908.788483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.788681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.788969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.789345] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.789528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 908.789647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.789962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 908.790415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.790598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 908.790963] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.060812] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7: rpc.has_security_group_logging(os_id): False [ 909.080055] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.080634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.080634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.080634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.080634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.080867] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.080867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.080973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.081090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.081147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.081320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.081455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.081547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.081758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.081877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.082409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.082517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.082574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.082724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.082800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.082888] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 is going to be created. [ 909.150265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.150453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.150539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.150764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.151036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.162742] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 in Status: IN_PROGRESS for 2s [ 909.221771] env[62815]: INFO networking_nsxv3.common.synchronization [req-700184d7-9b89-463e-b8e8-6f3b48edfbaf req-6d8f34a4-9069-47fd-94d3-df70b0b625cb tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 909.222686] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 909.223195] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.223457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.223575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.223845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.225561] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.225561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.225561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.225561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.225561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.225561] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.293435] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.293609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.293986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.293986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.294122] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.294239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.294317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.294504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.294615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.294740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.295207] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.295328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.295431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.295967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.295967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.295967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.295967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.297652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.297757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.297869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.298009] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.672041] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.672265] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.672408] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.672696] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.672987] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.673172] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.673303] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.673531] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.676697] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.676697] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.676697] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.676697] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.676697] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.676697] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 909.676697] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.676697] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.693417] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.693583] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.693814] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.694047] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.694360] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-c5f83c7e-593c-440b-8717-507e71ebd091 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.694532] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.694654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.694969] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.695564] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5f83c7e-593c-440b-8717-507e71ebd091',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.728699] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.804895] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d6bbb76-6d82-445e-a124-2538b600ecb4: rpc.has_security_group_logging(os_id): False [ 909.826102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.826102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.826102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.826102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.826848] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.826848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.826848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.829792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.830083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.830286] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 909.890742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.890742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.890742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.890742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.890742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 909.901679] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 909.923217] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2e411727-b5bb-4dc7-a6e4-8592c22ce278 None None] Enqueued Resource ID: d43718c5-d973-4969-9e92-c0513671f97e with Priority: HIGHEST for action port [ 909.923716] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43718c5-d973-4969-9e92-c0513671f97e with Priority: HIGHEST for action port [ 909.927878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d43718c5-d973-4969-9e92-c0513671f97e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.929016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d43718c5-d973-4969-9e92-c0513671f97e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 909.929016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d43718c5-d973-4969-9e92-c0513671f97e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.929016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d43718c5-d973-4969-9e92-c0513671f97e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 909.929016] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43718c5-d973-4969-9e92-c0513671f97e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.198113] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.198468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.199865] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.199865] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.199865] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.199865] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port c5f83c7e-593c-440b-8717-507e71ebd091 not found, creating... [ 910.199865] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.199865] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.199865] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.200222] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.200257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.200682] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.202290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.202290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.202290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.202513] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.202563] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: c5f83c7e-593c-440b-8717-507e71ebd091 is going to be created. [ 910.224052] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.224327] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.224481] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.224795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.225068] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.225319] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.231745] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.432818] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d43718c5-d973-4969-9e92-c0513671f97e [ 910.433742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.433742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.433742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.433742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.433742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.433742] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d43718c5-d973-4969-9e92-c0513671f97e already deleted. [ 910.434102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d43718c5-d973-4969-9e92-c0513671f97e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.734264] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.734422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.734495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.734793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.734851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.734953] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 910.765852] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.765998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 910.766086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.766307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 910.766447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 910.777361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 911.174216] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 in Status: SUCCESS [ 911.174445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.242342] env[62815]: INFO networking_nsxv3.common.synchronization [req-700184d7-9b89-463e-b8e8-6f3b48edfbaf req-c381aa1e-cc0e-4cba-89c2-cc9931c55c2c service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 911.242676] env[62815]: INFO networking_nsxv3.common.synchronization [req-700184d7-9b89-463e-b8e8-6f3b48edfbaf req-c381aa1e-cc0e-4cba-89c2-cc9931c55c2c service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 911.242676] env[62815]: INFO networking_nsxv3.common.synchronization [req-700184d7-9b89-463e-b8e8-6f3b48edfbaf req-c381aa1e-cc0e-4cba-89c2-cc9931c55c2c service nova] Enqueued Resource ID: c5f83c7e-593c-440b-8717-507e71ebd091 with Priority: HIGHEST for action port [ 911.242905] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 911.243044] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 911.243143] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5f83c7e-593c-440b-8717-507e71ebd091 with Priority: HIGHEST for action port [ 911.243736] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.243824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.243872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.244514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.244625] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.251851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.251948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.254266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5f83c7e-593c-440b-8717-507e71ebd091 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.254266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.254266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.254266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.254266] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5f83c7e-593c-440b-8717-507e71ebd091',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.753206] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.753745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.755374] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5f83c7e-593c-440b-8717-507e71ebd091 with status ACTIVE [ 911.755669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.755864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.756488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.756488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.756488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.756745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.756835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.756940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.757233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.757329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.757620] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.757855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.757971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.758215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.758340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.758470] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5f83c7e-593c-440b-8717-507e71ebd091 is going to be updated. [ 911.792080] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.792080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 911.792080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.792244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 911.792244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.792673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5f83c7e-593c-440b-8717-507e71ebd091" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 911.918476] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 911.919393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.124757] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a0515e56-fef5-46a7-8f53-d9e48c73f006 None None] Enqueued Resource ID: cc49a367-b19a-4e9a-851d-9d874ce063d3 with Priority: HIGHEST for action port [ 912.127645] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc49a367-b19a-4e9a-851d-9d874ce063d3 with Priority: HIGHEST for action port [ 912.128369] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc49a367-b19a-4e9a-851d-9d874ce063d3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.129027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc49a367-b19a-4e9a-851d-9d874ce063d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.129027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc49a367-b19a-4e9a-851d-9d874ce063d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.129027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc49a367-b19a-4e9a-851d-9d874ce063d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.129027] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc49a367-b19a-4e9a-851d-9d874ce063d3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.365311] env[62815]: INFO networking_nsxv3.common.synchronization [req-9c36f168-83f5-481b-8d36-431c8d8e359f req-fbb96d9e-ca65-4a63-9895-874dca2d3fb1 tempest-ServerAddressesNegativeTestJSON-449051300 tempest-ServerAddressesNegativeTestJSON-449051300-project-member] Enqueued Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_members [ 912.365978] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_members [ 912.367504] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.367635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.367709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.367974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.371513] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.371658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.371717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.371881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.371970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.372083] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.633796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc49a367-b19a-4e9a-851d-9d874ce063d3 [ 912.633796] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.633796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.633796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.633796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.633796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.633796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc49a367-b19a-4e9a-851d-9d874ce063d3 already deleted. [ 912.633796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc49a367-b19a-4e9a-851d-9d874ce063d3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.789359] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 912.789359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.789359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.789582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.789774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.789866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.789915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.790077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.790256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.790256] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.875541] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.875712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.875753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.876457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.876457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.876457] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.876457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 912.876457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.876711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 912.876711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 912.876711] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11303673-d09a-48d1-9cad-14317bc7650c already deleted. [ 912.876801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.229245] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.229497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-298" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.229645] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-298" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.229993] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-298" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.230892] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.231090] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.231223] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.234699] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.234699] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.234699] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.234879] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.234879] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.234964] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.237203] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.237203] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.237203] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.253744] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.253951] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.254136] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.254315] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-298" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.254606] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.254787] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.254913] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.255615] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.255615] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.293403] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.760572] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.760860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.760966] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.761255] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.761447] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.761614] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 not found, creating... [ 913.761886] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.762059] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.762184] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.762424] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.762566] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.762857] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.764287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.764287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.764287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.764287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.764552] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 is going to be created. [ 913.784201] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.784407] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 913.784537] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.785220] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 913.785476] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.786162] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 913.798779] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.192064] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c20c7de9-944a-424e-b869-e308068aec71 None None] Enqueued Resource ID: 399d617d-96fc-4f97-9c31-26795ce4e705 with Priority: HIGHEST for action port [ 914.192064] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399d617d-96fc-4f97-9c31-26795ce4e705 with Priority: HIGHEST for action port [ 914.194874] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-399d617d-96fc-4f97-9c31-26795ce4e705 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.194874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-399d617d-96fc-4f97-9c31-26795ce4e705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.194874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-399d617d-96fc-4f97-9c31-26795ce4e705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.194874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-399d617d-96fc-4f97-9c31-26795ce4e705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.194874] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('399d617d-96fc-4f97-9c31-26795ce4e705',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.302881] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.302881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.302881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.302881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.302881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.302881] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 914.331683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.332572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.334316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.334316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.334316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.345016] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 914.697362] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 399d617d-96fc-4f97-9c31-26795ce4e705 [ 914.697566] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.697703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.697773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.698011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.698114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.698210] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:399d617d-96fc-4f97-9c31-26795ce4e705 already deleted. [ 914.698292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-399d617d-96fc-4f97-9c31-26795ce4e705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.929679] env[62815]: INFO networking_nsxv3.common.synchronization [req-2097cd9f-6cc9-40f0-bb60-042cc690b76c req-23bafaee-d4c5-42ca-acbb-f8c04e473116 tempest-ServersTestBootFromVolume-393267422 tempest-ServersTestBootFromVolume-393267422-project-member] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_members [ 914.929679] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGHEST for action security_group_members [ 914.929679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.929679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.929679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.929679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.929679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.930250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 914.930250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.930250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 914.930250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 914.931770] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.189109] env[62815]: INFO networking_nsxv3.common.synchronization [req-9c36f168-83f5-481b-8d36-431c8d8e359f req-6833f881-6856-42c8-8340-22d1776a34ce service nova] Enqueued Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_rules [ 915.189315] env[62815]: INFO networking_nsxv3.common.synchronization [req-9c36f168-83f5-481b-8d36-431c8d8e359f req-6833f881-6856-42c8-8340-22d1776a34ce service nova] Enqueued Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_members [ 915.189485] env[62815]: INFO networking_nsxv3.common.synchronization [req-9c36f168-83f5-481b-8d36-431c8d8e359f req-6833f881-6856-42c8-8340-22d1776a34ce service nova] Enqueued Resource ID: dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 with Priority: HIGHEST for action port [ 915.190036] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_rules [ 915.192121] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_members [ 915.192121] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 with Priority: HIGHEST for action port [ 915.192121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.192121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.192121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.192121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.192121] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.192121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.192121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.192780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.192780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.192780] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.192780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.192780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.192780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.193356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.193356] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.194203] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.194203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.194203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.194203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.194203] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.433580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.434038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.434038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.434038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.455589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.455847] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.455977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.456052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.456260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.456405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.456455] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b is going to be updated. [ 915.483282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.483467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.483541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.483783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.483985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.493201] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: IN_PROGRESS for 2s [ 915.697418] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.701560] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.701709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.701794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 with status ACTIVE [ 915.701952] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.702263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.702365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.703640] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.703640] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.703640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.704327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.704327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.704327] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364 is going to be updated. [ 915.724424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.724424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 915.724424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.724424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 915.724424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 915.724772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbfd116d-499a-4d3d-9b7a-a3b0e9d9d364" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.013701] env[62815]: INFO networking_nsxv3.common.synchronization [None req-09d6f9a6-c511-4e03-b0c4-cb47177e8dc3 None None] Enqueued Resource ID: 26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3 with Priority: HIGHEST for action port [ 916.014009] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3 with Priority: HIGHEST for action port [ 916.014712] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.014797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.014839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.015100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.015633] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.206028] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.357027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.357027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.357027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.357027] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.524027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3 [ 916.524027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.524027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.524027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.524027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.524027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.524027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3 already deleted. [ 916.524027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d861fa-f35f-40f2-9be0-b6c9e4f9f9a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.711489] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.711489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.711489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.711489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.711489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.711489] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11303673-d09a-48d1-9cad-14317bc7650c is going to be created. [ 916.735571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.735571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.735571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.735571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.735571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.749769] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11303673-d09a-48d1-9cad-14317bc7650c in Status: UNINITIALIZED for 2s [ 916.859607] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.859775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.859835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.860044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.860205] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.860301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.860363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.860512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.860595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.861138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.861138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.861138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.861138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.861138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.861534] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.861534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 916.861534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.861687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 916.861687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.861772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 916.861817] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.235026] env[62815]: INFO networking_nsxv3.common.synchronization [None req-65f8ca5a-712f-4342-907b-1273139718a7 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 5351abe5-f688-4224-a4cc-3b2056806d64 with Priority: HIGHEST for action security_group_rules [ 917.235635] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5351abe5-f688-4224-a4cc-3b2056806d64 with Priority: HIGHEST for action security_group_rules [ 917.235964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5351abe5-f688-4224-a4cc-3b2056806d64 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.236522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.236626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.236933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.237057] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5351abe5-f688-4224-a4cc-3b2056806d64',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.340669] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a44ab563-dcee-4752-bba8-59fb217caec5 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 5351abe5-f688-4224-a4cc-3b2056806d64 with Priority: HIGHEST for action security_group_rules [ 917.341477] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5351abe5-f688-4224-a4cc-3b2056806d64 with Priority: HIGHEST for action security_group_rules [ 917.342011] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5351abe5-f688-4224-a4cc-3b2056806d64 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.342011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.367823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 917.386133] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.386231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.386266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.386463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.387048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.387048] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.387048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.387048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.387335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.387335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.387425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.387486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.387530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.387639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.387716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.387910] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.387998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.388399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.388561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.388644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.388734] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 917.465696] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.465878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.465925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.466142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.466316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.484285] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 917.503105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b in Status: SUCCESS [ 917.503293] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b deletion is rescheduled due to dependency. [ 917.504935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.767425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.767771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.767771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.767980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.768085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.768180] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5351abe5-f688-4224-a4cc-3b2056806d64 already deleted. [ 917.768268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 917.768419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.768572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.768786] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5351abe5-f688-4224-a4cc-3b2056806d64',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.997277] env[62815]: INFO networking_nsxv3.common.synchronization [None req-447ce033-d799-4043-a82a-f06d9c60a189 None None] Enqueued Resource ID: 0181fad8-9dff-43b4-8cf7-2fdd8f563821 with Priority: HIGHEST for action port [ 917.997896] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0181fad8-9dff-43b4-8cf7-2fdd8f563821 with Priority: HIGHEST for action port [ 917.998167] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0181fad8-9dff-43b4-8cf7-2fdd8f563821 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.998447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0181fad8-9dff-43b4-8cf7-2fdd8f563821" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 917.998447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0181fad8-9dff-43b4-8cf7-2fdd8f563821" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.998698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0181fad8-9dff-43b4-8cf7-2fdd8f563821" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 917.998769] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0181fad8-9dff-43b4-8cf7-2fdd8f563821',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.290030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.290392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.290392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.290475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.290633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.290722] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5351abe5-f688-4224-a4cc-3b2056806d64 already deleted. [ 918.290932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5351abe5-f688-4224-a4cc-3b2056806d64" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.502967] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0181fad8-9dff-43b4-8cf7-2fdd8f563821 [ 918.503486] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.503486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.503486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.503681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.503751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.503877] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0181fad8-9dff-43b4-8cf7-2fdd8f563821 already deleted. [ 918.503966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0181fad8-9dff-43b4-8cf7-2fdd8f563821" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.705128] env[62815]: INFO networking_nsxv3.common.synchronization [req-50da861d-a8f5-4629-9598-e7ef91c36e16 req-42a517fb-6647-4cac-84b6-dd79eb3c70fb tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 918.706398] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 918.706665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.706789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.706853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.707166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.707246] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.707327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.707415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.707515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.708253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.708253] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.764666] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11303673-d09a-48d1-9cad-14317bc7650c in Status: SUCCESS [ 918.764666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.764666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.764666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.765021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.765021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 918.765021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.765167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 918.765167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.765259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 918.765570] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.082505] env[62815]: INFO networking_nsxv3.common.synchronization [None req-968cda76-0052-4f2f-9051-50eeace89c58 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 919.083477] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 919.083477] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.083477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.213744] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.267385] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.267520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.267600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.267822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.267994] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.268115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.268198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.269661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.269661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.269661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.269661] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.269661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.269862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.270296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.270296] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.270296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.270296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.270570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.270570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.270639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.270668] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.498350] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 919.498625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.715952] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.775426] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11303673-d09a-48d1-9cad-14317bc7650c: rpc.has_security_group_logging(os_id): False [ 919.791924] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.792070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.792138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.792356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.792492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.792657] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.793648] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.793648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.794029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.794029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.794029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.794029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.794169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.794237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.794307] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11303673-d09a-48d1-9cad-14317bc7650c is going to be created. [ 919.849209] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.849209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 919.849406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.849549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 919.849677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 919.859321] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11303673-d09a-48d1-9cad-14317bc7650c in Status: IN_PROGRESS for 2s [ 920.219491] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.219671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.219749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.220222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.220338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.220447] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 920.245372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.245515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.245647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.245854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.246100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.255013] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 920.888364] env[62815]: INFO networking_nsxv3.common.synchronization [req-a24c3b6b-0dc8-430a-9415-ddfe5e7e564d req-9a96e19d-5948-4adf-a46a-d3151c824e8b tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 920.889749] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 920.891603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.891603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.891603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.891603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.891603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.891603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 920.891603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.891937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 920.891937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 920.891937] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.395375] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.395574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.395650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.395962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.417515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.417799] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.418058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.418163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.418460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.418577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.418678] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 921.468032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.468032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 921.468032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.468290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 921.468440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 921.478729] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 921.871355] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11303673-d09a-48d1-9cad-14317bc7650c in Status: SUCCESS [ 921.871355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.220175] env[62815]: INFO networking_nsxv3.common.synchronization [req-7eb8b9bf-1d2b-49b3-94fe-9ce63d629ab5 req-f3520be6-e050-46a2-997d-16faa868dac0 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_members [ 922.220175] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_members [ 922.223161] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.223500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.223752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.224157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.224524] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.225014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.225226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.225542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.225753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.225942] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.272020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.272020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.272020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.272020] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.729403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.731247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.731461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.731764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.731917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.732193] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.733660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.733660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.733868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.734024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.734278] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da already deleted. [ 922.734335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.776753] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.777021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.777157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.777413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.777629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.777879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.778041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.778150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.778454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.779144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.779915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 922.807546] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.807760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 922.807874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.808220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 922.808277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 922.816348] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 923.316433] env[62815]: INFO networking_nsxv3.common.synchronization [req-c43ec180-c599-419a-9120-bcc5da7261fd req-462e430d-4ecd-4271-8d07-b47844b1c05f tempest-InstanceActionsTestJSON-2053809201 tempest-InstanceActionsTestJSON-2053809201-project-member] Enqueued Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_members [ 923.317283] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 with Priority: HIGHEST for action security_group_members [ 923.317508] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.317635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.317691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.317898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.318076] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.318176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.318247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.318387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.318473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.318568] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.488855] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 923.489079] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 923.489217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.604119] env[62815]: INFO networking_nsxv3.common.synchronization [req-3a49bf75-350a-4767-a26c-8926fb8f72e7 req-a7d1a0b6-777d-42c2-b63e-cc2c4a9e8d30 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_members [ 923.604725] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGHEST for action security_group_members [ 923.605066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.605197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.605265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.605582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.605686] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.605799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.605864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.606297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.606377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.606504] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.615083] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.615083] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.615083] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.615389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.615717] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.616675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.616675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.616675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.616675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.617007] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.617195] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.617362] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.617536] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.617737] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 923.617908] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.618127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.639022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.639022] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 923.639022] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.639022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.639022] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-a4312113-d63e-4d3f-bc0c-04c72d230008 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.639022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.639022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.639022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.639022] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4312113-d63e-4d3f-bc0c-04c72d230008',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.744109] env[62815]: INFO networking_nsxv3.common.synchronization [req-574f5335-b5e9-4fca-8f6e-d30a7a6060ec req-6e7909d3-95f5-4e42-a428-e84047f46a73 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 923.744109] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 923.744109] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.744109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.744941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.745326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.745629] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.746027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.747056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.747056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.747056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.747056] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.824670] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.824670] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.824670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.824670] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 is going to be updated. [ 923.848000] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.848146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 923.848214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.848426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 923.848560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 923.863601] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 in Status: IN_PROGRESS for 2s [ 924.109101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.109101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.109101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.109297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.129558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.129806] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.131770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.131770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.131770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.131770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.131770] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 is going to be updated. [ 924.145780] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.146866] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.147010] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.147400] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.147495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.147636] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port a4312113-d63e-4d3f-bc0c-04c72d230008 not found, creating... [ 924.148536] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.148536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.148536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.148536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.148536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.148883] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.149139] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.149282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.149528] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.149664] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.149808] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: a4312113-d63e-4d3f-bc0c-04c72d230008 is going to be created. [ 924.152998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.153122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.153191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.155801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.155801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.162287] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17388f1d-f975-4b0c-9539-e72fee58d139 in Status: IN_PROGRESS for 2s [ 924.170294] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.170294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.170294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.170294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.170294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.170294] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.254796] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.473852] env[62815]: INFO networking_nsxv3.common.synchronization [req-a21b23f0-7e91-4ea4-89c2-c5dd963d1312 req-66adfc4d-0b57-4512-b111-bc00124d8baf tempest-ServersWithSpecificFlavorTestJSON-887013430 tempest-ServersWithSpecificFlavorTestJSON-887013430-project-member] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 924.473852] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGHEST for action security_group_members [ 924.474183] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.474303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.474370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.474566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.474710] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.474801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.474861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.475015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.475107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.475219] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.757746] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.833294] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 924.833477] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 deletion is rescheduled due to dependency. [ 924.833593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.978348] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.978492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.978566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.978791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.980892] env[62815]: INFO networking_nsxv3.common.synchronization [req-7eb8b9bf-1d2b-49b3-94fe-9ce63d629ab5 req-79cc6968-66d8-4296-9cc0-c42d2ae6396a service nova] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_rules [ 924.981162] env[62815]: INFO networking_nsxv3.common.synchronization [req-7eb8b9bf-1d2b-49b3-94fe-9ce63d629ab5 req-79cc6968-66d8-4296-9cc0-c42d2ae6396a service nova] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_members [ 924.981501] env[62815]: INFO networking_nsxv3.common.synchronization [req-7eb8b9bf-1d2b-49b3-94fe-9ce63d629ab5 req-79cc6968-66d8-4296-9cc0-c42d2ae6396a service nova] Enqueued Resource ID: a4312113-d63e-4d3f-bc0c-04c72d230008 with Priority: HIGHEST for action port [ 924.982409] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_rules [ 924.982756] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_members [ 924.983052] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4312113-d63e-4d3f-bc0c-04c72d230008 with Priority: HIGHEST for action port [ 924.983969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.984152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.986329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.986329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.986329] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.986329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.986329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.986329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.986329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.986329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.986329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.986634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.986695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.986814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 924.987918] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.988360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4312113-d63e-4d3f-bc0c-04c72d230008 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.989957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 924.989957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.989957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 924.989957] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4312113-d63e-4d3f-bc0c-04c72d230008',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.003038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.003447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.003695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.003875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.004158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.004341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.004487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be updated. [ 925.030074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.030234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.030330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.030611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.030809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.039839] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: IN_PROGRESS for 2s [ 925.259751] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.259959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.260070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.260366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.260492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.260626] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 925.288916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.288916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.289085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.289173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.289367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.297380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 925.489413] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.492407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.492800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.493096] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4312113-d63e-4d3f-bc0c-04c72d230008 with status ACTIVE [ 925.493370] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.493619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.493782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.494070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.494254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.495990] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.495990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.495990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.495990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.495990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.495990] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.496237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.496237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.496313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.496423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.496499] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4312113-d63e-4d3f-bc0c-04c72d230008 is going to be updated. [ 925.516656] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.516795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 925.516854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.517019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 925.517161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.517315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4312113-d63e-4d3f-bc0c-04c72d230008" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.873398] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 in Status: SUCCESS [ 925.873572] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7 deletion is rescheduled due to dependency. [ 925.873712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 925.991519] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.170867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17388f1d-f975-4b0c-9539-e72fee58d139 in Status: SUCCESS [ 926.171121] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 deletion is rescheduled due to dependency. [ 926.171268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.470283] env[62815]: INFO networking_nsxv3.common.synchronization [req-351b8440-d5be-4dc1-b310-77746ce556f5 req-f7ae8640-6d27-4fe8-8779-5c5e11ce3c75 tempest-ServersV294TestFqdnHostnames-377829194 tempest-ServersV294TestFqdnHostnames-377829194-project-member] Enqueued Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_members [ 926.470857] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_members [ 926.471239] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.471377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.471454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.471734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.471894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.471994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.472066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.472209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.472296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.472388] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.494490] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.494765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.494765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.494917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.495015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.495114] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da is going to be created. [ 926.523780] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.523780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.523780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.523780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.523780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.534024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: UNINITIALIZED for 2s [ 926.917349] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-665 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.917588] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-665" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.917726] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-665" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.918077] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-665" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.918473] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.919109] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.919281] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.920766] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.920766] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.920766] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.920766] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.920766] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.920766] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.920766] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.920766] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.921070] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.939746] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.939932] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.940087] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.940387] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-665" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.940586] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.940775] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.940885] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.941298] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.941672] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acb9effc-35e9-4bb0-8cc9-5e5655e1593e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.969556] env[62815]: INFO networking_nsxv3.common.synchronization [req-a7728d03-8b0e-4f96-bd14-3a533f82a02a req-0e44b3e6-5a7d-4b6f-8b94-05d74015fc75 tempest-ServersAdminTestJSON-775725945 tempest-ServersAdminTestJSON-775725945-project-member] Enqueued Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 926.970099] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 with Priority: HIGHEST for action security_group_members [ 926.970767] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50851b2f-e9ba-4c66-9351-f1d66386b1c2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.970767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.970767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.970967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.970967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.971071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.971244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.971309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.971344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.971558] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50851b2f-e9ba-4c66-9351-f1d66386b1c2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.974103] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.974277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.974277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.974428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.974563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.974682] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.974765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 926.974834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.974964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 926.975096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 926.976224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd already deleted. [ 926.976224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.048936] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a360f68-c409-4d28-9396-e41a05128638 in Status: SUCCESS [ 927.049187] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a360f68-c409-4d28-9396-e41a05128638 deletion is rescheduled due to dependency. [ 927.049328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.306732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 927.306950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.444295] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.444580] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.444721] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.445013] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.445184] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.445352] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port acb9effc-35e9-4bb0-8cc9-5e5655e1593e not found, creating... [ 927.445653] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.445825] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.445947] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.446247] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.446409] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.446774] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.446953] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.450310] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.450606] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.450773] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.450937] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: acb9effc-35e9-4bb0-8cc9-5e5655e1593e is going to be created. [ 927.473595] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.473595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.473595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.473962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.475912] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.475912] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.475912] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.476183] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.476596] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.476906] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.497202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.497480] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.497617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.497688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.497950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.498012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.498068] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 is going to be updated. [ 927.537637] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.537637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 927.537637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.537637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 927.537637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 927.556190] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: IN_PROGRESS for 2s [ 928.052683] env[62815]: INFO networking_nsxv3.common.synchronization [req-41a871df-075d-41a3-abcd-e423495fdc1a req-49af17c1-f417-4569-9497-d2acd7561b17 tempest-ServerAddressesNegativeTestJSON-449051300 tempest-ServerAddressesNegativeTestJSON-449051300-project-member] Enqueued Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_members [ 928.053513] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11303673-d09a-48d1-9cad-14317bc7650c with Priority: HIGHEST for action security_group_members [ 928.053803] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-11303673-d09a-48d1-9cad-14317bc7650c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.053933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.054024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.054276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.055488] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.055656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.055753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.055939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.056080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.056172] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11303673-d09a-48d1-9cad-14317bc7650c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.349019] env[62815]: INFO networking_nsxv3.common.synchronization [req-351b8440-d5be-4dc1-b310-77746ce556f5 req-5ad7c1b6-6e02-48d8-b1a8-ddb632cc8acb service nova] Enqueued Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_rules [ 928.349019] env[62815]: INFO networking_nsxv3.common.synchronization [req-351b8440-d5be-4dc1-b310-77746ce556f5 req-5ad7c1b6-6e02-48d8-b1a8-ddb632cc8acb service nova] Enqueued Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_members [ 928.349019] env[62815]: INFO networking_nsxv3.common.synchronization [req-351b8440-d5be-4dc1-b310-77746ce556f5 req-5ad7c1b6-6e02-48d8-b1a8-ddb632cc8acb service nova] Enqueued Resource ID: acb9effc-35e9-4bb0-8cc9-5e5655e1593e with Priority: HIGHEST for action port [ 928.349019] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_rules [ 928.349019] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_members [ 928.349019] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb9effc-35e9-4bb0-8cc9-5e5655e1593e with Priority: HIGHEST for action port [ 928.349019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.349019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.349019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.349019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.349019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.349916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.350060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.350128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.350329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.350513] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.350616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.350676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.350901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.350938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.353303] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.353303] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.353303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.353303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.353303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.353303] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acb9effc-35e9-4bb0-8cc9-5e5655e1593e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.543311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: SUCCESS [ 928.543632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.543783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.544046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.544242] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.544360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.544427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.544577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.544662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.544746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.544834] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.558704] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.558879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.558955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.559163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.559253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.559472] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.559574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.559638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.559781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.559857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.559941] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11303673-d09a-48d1-9cad-14317bc7650c is going to be updated. [ 928.585986] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.586145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.586218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.586420] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.586562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.594921] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11303673-d09a-48d1-9cad-14317bc7650c in Status: IN_PROGRESS for 2s [ 928.854019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.855090] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.855220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.855539] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acb9effc-35e9-4bb0-8cc9-5e5655e1593e with status ACTIVE [ 928.855697] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.856318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.856318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.856318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.856318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.856318] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.856581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.856581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.856581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.856713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.856856] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.856928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.857045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.858018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.858018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.858018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acb9effc-35e9-4bb0-8cc9-5e5655e1593e is going to be updated. [ 928.873020] env[62815]: INFO networking_nsxv3.common.synchronization [req-a4d76818-877a-4af8-9f9e-58bf596ef554 req-f5e41823-69ca-4186-b8ca-05d75f885470 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 928.873020] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 928.873020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.873020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.873020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.873020] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.877173] env[62815]: INFO networking_nsxv3.common.synchronization [req-7c226c1e-2186-4478-84df-2dcda8f992f3 req-e11ac520-9fee-461a-ad48-d0370f998dad tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 928.877173] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 928.877335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.877436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.877527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.878390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.878390] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.878390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.878390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.878390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.878390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.878390] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.886723] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.886896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 928.886985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.889034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 928.889034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 928.889034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acb9effc-35e9-4bb0-8cc9-5e5655e1593e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.046550] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.219548] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.219548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.219548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.220874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.220874] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.220874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.220874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.220874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.220874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.221559] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.221559] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.221559] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.221559] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.221559] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.221796] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.221796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.242479] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.242758] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.243938] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.243938] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.243938] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2bc0e820-e16e-4d2e-b690-b2508721ec28 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.244334] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.244821] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.245255] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.245493] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc0e820-e16e-4d2e-b690-b2508721ec28',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.355793] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.376130] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.380080] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.380290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.380432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.380780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.380819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.381068] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.381186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.381254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.381507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.381570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.381662] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be updated. [ 929.408928] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.409098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.409172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.409405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.409548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.421295] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: IN_PROGRESS for 2s [ 929.549195] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fff1e9e6-fc12-4fc6-91f0-37bb29ad92da: rpc.has_security_group_logging(os_id): False [ 929.565784] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 in Status: SUCCESS [ 929.566079] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50851b2f-e9ba-4c66-9351-f1d66386b1c2 deletion is rescheduled due to dependency. [ 929.566262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50851b2f-e9ba-4c66-9351-f1d66386b1c2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.567857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.568069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.568193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.568501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.568622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.568871] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.568976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.569071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.569242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.569319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.569405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da is going to be created. [ 929.623702] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.623855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.623929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.624166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.624350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.634356] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: IN_PROGRESS for 2s [ 929.748176] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.748421] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.748558] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.748852] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.749017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.749180] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2bc0e820-e16e-4d2e-b690-b2508721ec28 not found, creating... [ 929.749447] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.749635] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.749763] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.749988] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.750146] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.750444] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.750605] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.750727] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.750937] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.751151] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.751305] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2bc0e820-e16e-4d2e-b690-b2508721ec28 is going to be created. [ 929.772960] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.773179] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.773311] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.773564] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.773797] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.774026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.860044] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.860044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.860224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.860306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.860382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.860483] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd is going to be created. [ 929.881126] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.896106] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.896264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 929.896340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.896542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 929.896702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 929.907287] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd in Status: UNINITIALIZED for 2s [ 930.380261] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.380436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.380480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.380692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.380784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.380879] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 930.406511] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.406511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.406511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.406511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.406693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.416992] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 930.603471] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11303673-d09a-48d1-9cad-14317bc7650c in Status: SUCCESS [ 930.603814] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11303673-d09a-48d1-9cad-14317bc7650c deletion is rescheduled due to dependency. [ 930.603814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11303673-d09a-48d1-9cad-14317bc7650c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 930.648157] env[62815]: INFO networking_nsxv3.common.synchronization [req-a4d76818-877a-4af8-9f9e-58bf596ef554 req-4792cf26-8bba-448a-ab3e-337e9b1c0bd2 service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 930.648157] env[62815]: INFO networking_nsxv3.common.synchronization [req-a4d76818-877a-4af8-9f9e-58bf596ef554 req-4792cf26-8bba-448a-ab3e-337e9b1c0bd2 service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 930.648157] env[62815]: INFO networking_nsxv3.common.synchronization [req-a4d76818-877a-4af8-9f9e-58bf596ef554 req-4792cf26-8bba-448a-ab3e-337e9b1c0bd2 service nova] Enqueued Resource ID: 2bc0e820-e16e-4d2e-b690-b2508721ec28 with Priority: HIGHEST for action port [ 930.648462] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 930.648648] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 930.648757] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc0e820-e16e-4d2e-b690-b2508721ec28 with Priority: HIGHEST for action port [ 930.649326] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.649449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.649511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.649718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.649797] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.650947] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.651082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.651248] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bc0e820-e16e-4d2e-b690-b2508721ec28 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.651343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 930.651403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.651602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 930.651686] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc0e820-e16e-4d2e-b690-b2508721ec28',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.153528] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.153695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.153849] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bc0e820-e16e-4d2e-b690-b2508721ec28 with status ACTIVE [ 931.154035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.154146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.154210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.154426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.154517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.154696] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.154806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.154857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.154976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.155072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.155247] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.155339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.155396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.155535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.155610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.155692] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bc0e820-e16e-4d2e-b690-b2508721ec28 is going to be updated. [ 931.179314] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.179314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.179314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.179314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.179314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.179314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bc0e820-e16e-4d2e-b690-b2508721ec28" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.269956] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-2b00b64e-ec48-42b1-aa4c-ad9c750a1137 tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 931.270532] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 931.270857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.270999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.271249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.271630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.271872] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.272050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.272170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.272394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.272518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.272627] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.432355] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 931.432561] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 deletion is rescheduled due to dependency. [ 931.432874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.529035] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-ed81e91b-94d4-4635-8bb7-904ec877a4b7 tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 931.529728] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 931.530045] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.530151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.649353] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: SUCCESS [ 931.649353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.777099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.777099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.777099] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 already deleted. [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.777099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.777099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.778091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.778091] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.918201] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd in Status: SUCCESS [ 931.918489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.918832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.919017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.919135] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.919251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 931.919315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.919497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 931.919596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.919685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 931.919797] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.056571] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-1f820210-24ff-4568-9835-1922940b4d2d tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 932.057571] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 932.057891] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.057999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.281162] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.281303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.281377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.281725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.281777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.281942] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.282054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.282119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.282270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.282347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.282432] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 already deleted. [ 932.282534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.282735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.282959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.283110] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.283255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.283255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.283344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.283412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.283501] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.401051] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.401051] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.401051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.401663] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.401919] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.402233] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.402459] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.402726] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.402956] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.403204] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.426182] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.430890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 932.431191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.431459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.431726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.431931] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.432096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.432189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.432362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.432450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.432679] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.441823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.441823] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 932.441823] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.441823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.441823] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.441823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.441823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.441823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.441823] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc0d7a1b-f71a-4853-96bd-36f6fa61083e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.785808] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.786222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.786222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.786303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.786410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.786622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.786728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.786803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.786966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.787064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.787154] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 already deleted. [ 932.787236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.927871] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f996b59-23a9-402b-8f9c-3e070b4b44dd: rpc.has_security_group_logging(os_id): False [ 932.940199] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.945535] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.945863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.945939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.946433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.946542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.947145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.947145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.947243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.947379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.947428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.947595] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd is going to be created. [ 932.949222] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.949448] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.950069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.950069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.950069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.950250] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port bc0d7a1b-f71a-4853-96bd-36f6fa61083e not found, creating... [ 932.950452] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.950669] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.950764] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.951136] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.951279] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.951676] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.951834] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.952299] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.952299] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.952364] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.952521] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: bc0d7a1b-f71a-4853-96bd-36f6fa61083e is going to be created. [ 932.973198] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.973490] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 932.973807] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.973861] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 932.974080] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 932.974309] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.011197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.011197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.011197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.011197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.011197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.021327] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd in Status: IN_PROGRESS for 2s [ 933.440661] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.944740] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.945107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.945107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.945185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.945281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.945378] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 933.971704] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.974796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 933.974796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.974796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 933.974796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 933.980575] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 934.024128] env[62815]: INFO networking_nsxv3.common.synchronization [req-3f16406a-15b9-4f51-82b8-2bc2c099e00b req-0b58a362-4816-4d5f-a0d7-51a49b414db6 tempest-ServerRescueTestJSON-307513274 tempest-ServerRescueTestJSON-307513274-project-member] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 934.024694] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 934.025158] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.025244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.025296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.025963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.026345] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.026709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.026817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.030017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.030017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.030017] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.092821] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-57f89eaf-9092-4b42-921f-dbe4c70ecf0e service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 934.093054] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-57f89eaf-9092-4b42-921f-dbe4c70ecf0e service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 934.093134] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-57f89eaf-9092-4b42-921f-dbe4c70ecf0e service nova] Enqueued Resource ID: bc0d7a1b-f71a-4853-96bd-36f6fa61083e with Priority: HIGHEST for action port [ 934.093386] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 934.093473] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 934.093600] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc0d7a1b-f71a-4853-96bd-36f6fa61083e with Priority: HIGHEST for action port [ 934.094149] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.094273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.094337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.094575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.094660] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.097921] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.098027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.098112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.098267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.098426] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.098519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.098579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.098720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.098801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.098886] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.099678] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.099817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.099892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.099987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.100070] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc0d7a1b-f71a-4853-96bd-36f6fa61083e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.392092] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.392310] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.392438] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.392787] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.393072] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.393288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.393381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.393604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.393755] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.393969] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.394104] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.394232] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.394349] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.394465] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.394573] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.394712] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.412507] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.412771] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.412842] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.413029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.413338] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e90eed75-a518-4cd5-a95d-cfb29507f3ba taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.413513] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.413642] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.413975] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.414139] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90eed75-a518-4cd5-a95d-cfb29507f3ba',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.532189] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.532400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.532516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.532821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.532994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.533270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.533384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.533448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.533610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.533682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.533769] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 already deleted. [ 934.533892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.602473] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc0d7a1b-f71a-4853-96bd-36f6fa61083e with status ACTIVE [ 934.602473] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.602473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.602473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.602473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.602473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.602805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.602805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.602881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.604029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.604029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.604029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.604029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.604029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.604029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.604029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.604029] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc0d7a1b-f71a-4853-96bd-36f6fa61083e is going to be updated. [ 934.604871] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.605009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.605151] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.626547] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.626547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.626547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.626547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.626771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.626959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc0d7a1b-f71a-4853-96bd-36f6fa61083e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.898665] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.898940] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.899096] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.899605] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.899932] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.900159] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.900308] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.900605] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.900820] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.901076] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.901234] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.901367] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.901550] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.901725] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.901862] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.902046] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.916676] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.916946] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.917086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.917420] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.917603] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.917781] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e90eed75-a518-4cd5-a95d-cfb29507f3ba not found, creating... [ 934.918066] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.918251] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.918375] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.918621] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.918788] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.919117] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.919288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.919587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.919833] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.919992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.920151] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e90eed75-a518-4cd5-a95d-cfb29507f3ba is going to be created. [ 934.922065] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.922237] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.922388] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.922572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-705" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.922880] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.923076] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.923204] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.923523] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.923687] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa1b7e9a-78e1-4040-a5e9-1a324f8b131e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.942789] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.943044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 934.943180] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.943480] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 934.943751] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 934.944045] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.040650] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd in Status: SUCCESS [ 935.040932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.107948] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.426845] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.427171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.427265] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.427560] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.427685] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.427846] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port aa1b7e9a-78e1-4040-a5e9-1a324f8b131e not found, creating... [ 935.428125] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.428289] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.428411] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.429259] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.429259] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.430544] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.430544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.430544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.430544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.430544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.430544] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: aa1b7e9a-78e1-4040-a5e9-1a324f8b131e is going to be created. [ 935.449692] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.450511] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.450511] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.450511] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.450663] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.450787] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.610601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.610792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.610880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.611158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.611256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.611372] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be created. [ 935.643525] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.647871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.647952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.648187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.648347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.658463] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: UNINITIALIZED for 2s [ 935.759282] env[62815]: INFO networking_nsxv3.common.synchronization [req-3f16406a-15b9-4f51-82b8-2bc2c099e00b req-30df9f16-8515-40ba-a5be-e85ce645dc71 service nova] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_rules [ 935.759482] env[62815]: INFO networking_nsxv3.common.synchronization [req-3f16406a-15b9-4f51-82b8-2bc2c099e00b req-30df9f16-8515-40ba-a5be-e85ce645dc71 service nova] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 935.759635] env[62815]: INFO networking_nsxv3.common.synchronization [req-3f16406a-15b9-4f51-82b8-2bc2c099e00b req-30df9f16-8515-40ba-a5be-e85ce645dc71 service nova] Enqueued Resource ID: e90eed75-a518-4cd5-a95d-cfb29507f3ba with Priority: HIGHEST for action port [ 935.760528] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_rules [ 935.760528] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 935.760528] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90eed75-a518-4cd5-a95d-cfb29507f3ba with Priority: HIGHEST for action port [ 935.761296] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.761502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.761665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.761981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.762174] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.763337] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.763510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.763620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.763960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.764251] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.764466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.764522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.764716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.764863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.765098] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.766763] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90eed75-a518-4cd5-a95d-cfb29507f3ba taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.766936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.767074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.767282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.767406] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90eed75-a518-4cd5-a95d-cfb29507f3ba',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.989406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 935.989677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.989855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.990089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.990287] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.990420] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 935.990594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.990657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 935.990719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.990806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 935.990916] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.219101] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-3d2a573a-10d2-497e-bcd3-4c46428d7f34 service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 936.219387] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-3d2a573a-10d2-497e-bcd3-4c46428d7f34 service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 936.219530] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-3d2a573a-10d2-497e-bcd3-4c46428d7f34 service nova] Enqueued Resource ID: aa1b7e9a-78e1-4040-a5e9-1a324f8b131e with Priority: HIGHEST for action port [ 936.220250] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 936.220463] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 936.220542] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1b7e9a-78e1-4040-a5e9-1a324f8b131e with Priority: HIGHEST for action port [ 936.220932] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.221067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.223022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.223124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.223344] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.223469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.223533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.223742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.223826] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa1b7e9a-78e1-4040-a5e9-1a324f8b131e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.267210] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.271851] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e90eed75-a518-4cd5-a95d-cfb29507f3ba with status ACTIVE [ 936.271851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.271851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.271851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.271851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.271851] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e90eed75-a518-4cd5-a95d-cfb29507f3ba is going to be updated. [ 936.273449] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.273449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.292253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.292425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.292477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.292732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.292883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.293295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90eed75-a518-4cd5-a95d-cfb29507f3ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.495667] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.495827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.495877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.496112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.496294] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.496365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.496424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.496566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.496644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.496728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.496893] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.496982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.497054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.497191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.497325] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.497412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.497469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.497609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.497676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.497753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.497849] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.726662] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa1b7e9a-78e1-4040-a5e9-1a324f8b131e with status ACTIVE [ 936.726981] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.727198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.727285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.727591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.727710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.727968] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.728148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.729654] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.729654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.729654] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa1b7e9a-78e1-4040-a5e9-1a324f8b131e is going to be updated. [ 936.751604] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.751823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 936.751938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.752270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 936.752486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.752749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa1b7e9a-78e1-4040-a5e9-1a324f8b131e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 936.769329] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.000587] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95315c29-36f4-4fb3-afae-f96b062c5650: rpc.has_security_group_logging(os_id): False [ 937.019203] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.019203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.019203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.019475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.019475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.019902] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.019902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.019902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.020098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.020098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.020260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.020355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.020416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.020551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.020767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.020975] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.022846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.022846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.023094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.023094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.023161] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 937.076821] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.077021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.077115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.077313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.077458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.089442] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 937.274384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.274384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.274384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.274384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.274384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.274384] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be created. [ 937.295199] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.295659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.296111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.298012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.298012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.308095] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: UNINITIALIZED for 2s [ 937.612197] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.612409] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.612567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.613499] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.613924] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.614130] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.614272] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.614542] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.614691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.614908] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.615040] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.615198] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.615314] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.615475] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.615632] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.615771] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.642200] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.642455] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 937.642665] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.642899] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.643270] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-973094d6-5895-492f-adf4-c734e5c6a2b1 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.643488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.643630] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.645627] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.645839] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973094d6-5895-492f-adf4-c734e5c6a2b1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.669210] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 937.669455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.669631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.669855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.670059] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.670175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.670238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.670387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.670757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.670757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.670757] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.673204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.673204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.673204] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.673204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 937.673204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.673204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 937.673204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 937.673204] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.149827] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.150137] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.150310] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.150600] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.150759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.150923] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 973094d6-5895-492f-adf4-c734e5c6a2b1 not found, creating... [ 938.151212] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.151379] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.151502] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.151765] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.151915] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.152225] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.152389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.152514] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.152734] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.152890] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.154632] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 973094d6-5895-492f-adf4-c734e5c6a2b1 is going to be created. [ 938.173419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.173559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.174868] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.175086] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 938.175220] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.175507] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 938.175749] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.175985] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 938.177187] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.679741] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.106225] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 939.106498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.182421] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.182645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.182732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.182958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.183097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.183216] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 939.212934] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.213480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.213605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.213932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.214169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.224988] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 939.318439] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 939.318726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.318872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.319115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.319409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.319503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.319503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.319962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.319962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.319962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.319962] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.368321] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-e67e2d4e-1b6f-433d-b4ba-bb812217b8bd service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 939.368600] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-e67e2d4e-1b6f-433d-b4ba-bb812217b8bd service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 939.368752] env[62815]: INFO networking_nsxv3.common.synchronization [req-2526eed0-7c33-4a55-8606-7c876af625a5 req-e67e2d4e-1b6f-433d-b4ba-bb812217b8bd service nova] Enqueued Resource ID: 973094d6-5895-492f-adf4-c734e5c6a2b1 with Priority: HIGHEST for action port [ 939.368995] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 939.369134] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 939.369228] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 973094d6-5895-492f-adf4-c734e5c6a2b1 with Priority: HIGHEST for action port [ 939.369834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.369935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.370984] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.371173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.374249] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-973094d6-5895-492f-adf4-c734e5c6a2b1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.374430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.374515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.374812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.374913] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973094d6-5895-492f-adf4-c734e5c6a2b1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.827095] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.827467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.827467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.827589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.827758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.827859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.827922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.828081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.828171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.828258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.828402] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.828493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.828599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.828739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.828903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.829224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.829377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.829544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.829665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.829761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.829855] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.880546] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 973094d6-5895-492f-adf4-c734e5c6a2b1 with status ACTIVE [ 939.880779] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.880912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.880984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.881214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.881299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.881475] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.881628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.881685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.881831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.881907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.882101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.882195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.882256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.882394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.882467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.882568] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 973094d6-5895-492f-adf4-c734e5c6a2b1 is going to be updated. [ 939.902606] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.902606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 939.902606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.902606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 939.902606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 939.902965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-973094d6-5895-492f-adf4-c734e5c6a2b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.333873] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7122d614-52b1-4ea3-88d7-21b71b12c2e4: rpc.has_security_group_logging(os_id): False [ 940.352016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.352016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.352016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.352016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.352592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.352592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.352592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.352592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.352592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.352592] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be created. [ 940.396150] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7b5ae3a-46da-4134-8116-2f3f1d3c47f2 req-e4acb63c-0751-484a-8311-b08682434ba8 tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 940.400641] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 940.401083] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.401221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.401290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.401572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.401723] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.401826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.401890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.402055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.402158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.402228] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.404609] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.405669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.406591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.406591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.407252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.419180] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: IN_PROGRESS for 2s [ 940.674888] env[62815]: INFO networking_nsxv3.common.synchronization [None req-42027470-a94e-4c31-8d79-2c66f23a391f None None] Enqueued Resource ID: 1496e856-c7af-4a5e-b1fb-231a06c34c73 with Priority: HIGHEST for action port [ 940.675395] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1496e856-c7af-4a5e-b1fb-231a06c34c73 with Priority: HIGHEST for action port [ 940.676025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1496e856-c7af-4a5e-b1fb-231a06c34c73 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.677270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1496e856-c7af-4a5e-b1fb-231a06c34c73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.677494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1496e856-c7af-4a5e-b1fb-231a06c34c73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.677573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1496e856-c7af-4a5e-b1fb-231a06c34c73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.678721] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1496e856-c7af-4a5e-b1fb-231a06c34c73',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.711369] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.711666] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.711799] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.712352] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.712716] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.712909] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.713044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.713372] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.713437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.714160] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.714160] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.714160] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.714160] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.714160] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.714370] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.714370] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.735622] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.735863] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.736351] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.736351] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.736579] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-501fb600-4449-4ef2-8b18-d67ade32e281 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.736803] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.736960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.737465] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.737597] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('501fb600-4449-4ef2-8b18-d67ade32e281',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.904949] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.905410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.905410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.905504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.905623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.906909] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.907049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 940.907117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.907311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 940.907432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 940.907552] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d already deleted. [ 940.907646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.181414] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1496e856-c7af-4a5e-b1fb-231a06c34c73 [ 941.181729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.181851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.181919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.182235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.182331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.182427] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1496e856-c7af-4a5e-b1fb-231a06c34c73 already deleted. [ 941.182516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1496e856-c7af-4a5e-b1fb-231a06c34c73" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.235578] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 941.235839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.235975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.236218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.236430] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.236545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.236611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.236763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.236845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.236941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.237131] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.237214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.237274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.237416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.237555] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.237648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.237711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.237847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.237920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.237997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.238102] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.238971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.239154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.239311] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.239411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.239474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.239614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.239690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.239779] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.240823] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.241025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.241160] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.241461] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.241721] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.241809] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 501fb600-4449-4ef2-8b18-d67ade32e281 not found, creating... [ 941.242093] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.242812] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.242812] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.242934] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.243387] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.243387] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.243544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.243667] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.247758] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.247758] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.247758] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 501fb600-4449-4ef2-8b18-d67ade32e281 is going to be created. [ 941.265935] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.266175] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.266311] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.267365] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.267473] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.267700] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.747782] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.748780] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d50f35ff-72d3-4ef9-9449-f84f0a4d4e25: rpc.has_security_group_logging(os_id): False [ 941.768998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.769253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.769433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.769638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.769768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.770134] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.770291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.770382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.770573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.770684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.770907] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.771045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.771132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.771312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.771422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.771685] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.771816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.771899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.772082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.772187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.772295] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be created. [ 941.826837] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.827116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 941.827116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.827289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 941.827468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 941.837897] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 942.155744] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7b5ae3a-46da-4134-8116-2f3f1d3c47f2 req-4d626b54-829b-458b-af23-18ead22c27e9 service nova] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_rules [ 942.156020] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7b5ae3a-46da-4134-8116-2f3f1d3c47f2 req-4d626b54-829b-458b-af23-18ead22c27e9 service nova] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 942.156092] env[62815]: INFO networking_nsxv3.common.synchronization [req-b7b5ae3a-46da-4134-8116-2f3f1d3c47f2 req-4d626b54-829b-458b-af23-18ead22c27e9 service nova] Enqueued Resource ID: 501fb600-4449-4ef2-8b18-d67ade32e281 with Priority: HIGHEST for action port [ 942.156349] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_rules [ 942.156481] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 942.156578] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501fb600-4449-4ef2-8b18-d67ade32e281 with Priority: HIGHEST for action port [ 942.157433] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.157581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.157651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.157960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.158090] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.159124] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.159248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.159314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.159602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.159692] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.159769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.159821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.159963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.160064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.160160] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.164102] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-501fb600-4449-4ef2-8b18-d67ade32e281 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.164270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.164340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.164521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.164602] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('501fb600-4449-4ef2-8b18-d67ade32e281',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.251427] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.434437] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 942.434533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.666546] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.667652] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.671211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.671717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 501fb600-4449-4ef2-8b18-d67ade32e281 with status ACTIVE [ 942.671930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.672067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.672151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.672380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.672471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.672695] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.672794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.672847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.672994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.673089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.673294] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.673391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.673451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.673595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.673672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.673756] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 501fb600-4449-4ef2-8b18-d67ade32e281 is going to be updated. [ 942.693856] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.694079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.694079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.694304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.694444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.694610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-501fb600-4449-4ef2-8b18-d67ade32e281" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.757194] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.757403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.757403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.757640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.757736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.757834] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 942.789350] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.789350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 942.789489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.790468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 942.790468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 942.816044] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 943.172495] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.367596] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.367886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.368052] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.368339] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.368610] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.368813] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.368978] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.369273] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.369430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.369674] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.369799] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.369915] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.370040] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.370159] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.370277] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.370403] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.381049] env[62815]: INFO networking_nsxv3.common.synchronization [None req-abd1f86c-06dc-4479-ba62-b4d39f0cd4cf None None] Enqueued Resource ID: ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0 with Priority: HIGHEST for action port [ 943.381289] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0 with Priority: HIGHEST for action port [ 943.381594] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.381714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.381779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.382064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.382165] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.390018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.390018] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.390018] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.390018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-825" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.390018] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-f96104f3-1d92-43cf-a297-c712c968910d taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.390018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.390018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.390506] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.390506] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96104f3-1d92-43cf-a297-c712c968910d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.675279] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.675446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.675520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.675743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.675839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.675934] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be created. [ 943.713152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.713341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.713405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.713602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.713743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.727659] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: UNINITIALIZED for 2s [ 943.850916] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 943.851357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.851524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.851789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.852086] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.889053] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0 [ 943.889053] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.889053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.889053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.889053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.889053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.889379] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0 already deleted. [ 943.889379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac1df6fc-15b2-49eb-ae94-62aac6d8dbe0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.893242] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.893904] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.893904] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.893904] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.894305] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.894348] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.894524] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.894650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.895127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.895290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.895592] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.895872] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.896032] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.896258] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.896403] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.896552] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: f96104f3-1d92-43cf-a297-c712c968910d is going to be updated. [ 943.915874] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.916113] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 943.916272] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.916554] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 943.916759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 943.916981] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.354612] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.354612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.666220] env[62815]: INFO networking_nsxv3.common.synchronization [req-52cadb6f-9503-497e-b01d-8ca1ef442520 req-2186e6a3-d89e-47a6-b15a-c71323674b9e service nova] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_rules [ 944.666220] env[62815]: INFO networking_nsxv3.common.synchronization [req-52cadb6f-9503-497e-b01d-8ca1ef442520 req-2186e6a3-d89e-47a6-b15a-c71323674b9e service nova] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 944.666220] env[62815]: INFO networking_nsxv3.common.synchronization [req-52cadb6f-9503-497e-b01d-8ca1ef442520 req-2186e6a3-d89e-47a6-b15a-c71323674b9e service nova] Enqueued Resource ID: f96104f3-1d92-43cf-a297-c712c968910d with Priority: HIGHEST for action port [ 944.666220] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_rules [ 944.666220] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 944.666220] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f96104f3-1d92-43cf-a297-c712c968910d with Priority: HIGHEST for action port [ 944.666220] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.666919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.667136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.667578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.667797] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.670025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.670025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.670025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.670025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.670025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.670025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.670025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.670025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.670656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.670849] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.672260] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f96104f3-1d92-43cf-a297-c712c968910d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.672543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.672747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.673046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.674506] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96104f3-1d92-43cf-a297-c712c968910d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.825574] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 944.825815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.825993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.826320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.826599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.826739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 944.826818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.827065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 944.827378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.827378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 944.827540] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.175095] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.176882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.177096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.177255] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f96104f3-1d92-43cf-a297-c712c968910d with status ACTIVE [ 945.177421] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.177530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.177595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.177824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.177922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.178142] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.178242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.178298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.178494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.178581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.178850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.178976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.179040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.179191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.179269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.179353] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f96104f3-1d92-43cf-a297-c712c968910d is going to be updated. [ 945.202935] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.203909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.204085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.204458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.204752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.205055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f96104f3-1d92-43cf-a297-c712c968910d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.335077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.335077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.335077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.335077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.335077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.335767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.335767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.335767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.335767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.335767] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.677496] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.736873] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 945.737118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.737341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.737491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.737680] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.737828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.737908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.738099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.738189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.738244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.738347] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.839872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d50f35ff-72d3-4ef9-9449-f84f0a4d4e25: rpc.has_security_group_logging(os_id): False [ 945.856224] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.856363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.856438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.856654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.857181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.857181] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.857603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.857603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.857603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.857603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.857758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.857820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.857851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.858756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.858756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.858756] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.858924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.858971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.859118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.859190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.859272] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 945.912846] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.913019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 945.913099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.913301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 945.913443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 945.926461] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 946.181453] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.181653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.181753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.181988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.182103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.182214] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 946.209644] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.209738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.209831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.210010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.210161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.217928] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 946.246618] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.246815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.246889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.247153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.247327] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.247444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.247510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.247680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.247772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.247882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.248265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.248265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.248265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.248384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.248463] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.248558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.248641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.248816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.248894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.248977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.249115] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.301019] env[62815]: INFO networking_nsxv3.common.synchronization [req-c87c1f30-1f00-44bc-8902-a36c9da7bf62 req-d8426176-879f-4feb-9d03-561d4eae2736 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 946.301019] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 946.301019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.301019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.301019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.301019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.667459] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.667675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.667807] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.668114] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.668383] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.668551] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.668676] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.668900] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.669068] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.669306] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.669426] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.669541] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.669683] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.669886] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.670048] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.670214] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.689733] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.690094] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.690270] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.690536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.690948] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e046ce62-3c77-4592-bfbf-e85da8787815 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.691153] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.691284] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.691705] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.691869] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e046ce62-3c77-4592-bfbf-e85da8787815',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.751901] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0748a1f-4ae2-44e2-8ece-647fc8e0c23d: rpc.has_security_group_logging(os_id): False [ 946.776912] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.777156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.777260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.777523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.777628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.777901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.778030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.778134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.778318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.778406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.778644] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.778761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.778824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.779029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.779120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.779333] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.779494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.779604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.779806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.779890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.779980] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be created. [ 946.802448] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.802633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.802725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.802994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.803115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.803310] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.803430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.803496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.803691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.803770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.803864] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 946.830313] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.830313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.830541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.830590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.830712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.838628] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 946.843781] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.843940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 946.844039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.844271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 946.844481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 946.855522] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 947.195767] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.199018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e046ce62-3c77-4592-bfbf-e85da8787815 not found, creating... [ 947.199018] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.199018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.199644] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.199644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.199644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.199644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.199644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.199644] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e046ce62-3c77-4592-bfbf-e85da8787815 is going to be created. [ 947.218608] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.218608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.218608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.218608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.218843] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.218914] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.914457] env[62815]: INFO networking_nsxv3.common.synchronization [req-c87c1f30-1f00-44bc-8902-a36c9da7bf62 req-e5d33824-a009-4d1c-92ef-bcaa084a3943 service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 947.914747] env[62815]: INFO networking_nsxv3.common.synchronization [req-c87c1f30-1f00-44bc-8902-a36c9da7bf62 req-e5d33824-a009-4d1c-92ef-bcaa084a3943 service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 947.914893] env[62815]: INFO networking_nsxv3.common.synchronization [req-c87c1f30-1f00-44bc-8902-a36c9da7bf62 req-e5d33824-a009-4d1c-92ef-bcaa084a3943 service nova] Enqueued Resource ID: e046ce62-3c77-4592-bfbf-e85da8787815 with Priority: HIGHEST for action port [ 947.915057] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 947.915239] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 947.915348] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e046ce62-3c77-4592-bfbf-e85da8787815 with Priority: HIGHEST for action port [ 947.915903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.917836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.918054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.918305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.918425] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.920168] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.920168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.920168] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e046ce62-3c77-4592-bfbf-e85da8787815 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.920168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 947.920168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.920168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.920168] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e046ce62-3c77-4592-bfbf-e85da8787815',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.946315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 947.947256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 947.947256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.947256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 947.947256] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.229057] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 948.229672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.229672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.229672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.229891] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.230178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.230178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.230178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.230735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.230735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.230735] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.422700] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.422700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.425079] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e046ce62-3c77-4592-bfbf-e85da8787815 with status ACTIVE [ 948.425377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.425520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.425639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.425904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.426048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.426306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.426453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.426521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.426688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.426771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.427061] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.427173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.427235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.427426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.427518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.427613] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e046ce62-3c77-4592-bfbf-e85da8787815 is going to be updated. [ 948.446153] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.446423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.446423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.448015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.448015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.448015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e046ce62-3c77-4592-bfbf-e85da8787815" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.449323] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.449323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.449532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.449532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.449665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.449751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.449808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.449939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.450032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.450116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.450345] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.734028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.734028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.734028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.734028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.734028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.734028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.734028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.734446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.734446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.734446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.734446] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.734585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.734585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.738031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.738031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.738031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.738031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.738031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.738031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.738031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.738031] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.847723] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 948.847883] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 948.848009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.848166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.848383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.848561] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.848675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.848740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.848886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.848967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.849077] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.868019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 948.868019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.952155] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.952617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.952617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.952617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.952755] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.952847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.952925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.953098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.953188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.953275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.953435] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.953527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.953622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.953793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.953938] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.954040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 948.954102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.954235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 948.954311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.954394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 948.954486] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.237490] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 686574a8-1080-450a-a759-40ce406709a1: rpc.has_security_group_logging(os_id): False [ 949.258743] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.258947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.259117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.259371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.278757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.279157] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.279259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.279294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.279578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.279685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.279921] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.280106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.280765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.280765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.280765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.280765] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.280975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.280975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.281144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.281217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.281409] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 949.342939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.342939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.342939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.343191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.343403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.350591] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.358049] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 949.456764] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d50f35ff-72d3-4ef9-9449-f84f0a4d4e25: rpc.has_security_group_logging(os_id): False [ 949.475316] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.478297] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.478297] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.478297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.478920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.478920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.478920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.478920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.478920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.478920] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 949.523901] env[62815]: INFO networking_nsxv3.common.synchronization [req-17c54e1f-f3d5-403d-a879-bfa4ba581cdf req-5c86d17c-5340-47db-ab7e-5db695e6b464 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 949.524480] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 949.524802] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.524918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.525042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.525326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.525483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.525613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.525717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.525959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.526301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.526301] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.554388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.554534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 949.555135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.555135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 949.555135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 949.569135] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 949.854142] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.028750] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.356871] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.357016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.357109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.357381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.357444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.357550] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 950.385730] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.386012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 950.386012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.386235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 950.386430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 950.394717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 950.531955] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.034429] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.034881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.034881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.036932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.037283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.037398] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 951.073475] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.073475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 951.073475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.073475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 951.073475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.082428] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 951.377145] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 951.378066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 951.584600] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 951.584798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.408247] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 952.408247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.408247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.408578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.408578] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.409891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.410025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.410257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.413213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.413338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.413446] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.450408] env[62815]: INFO networking_nsxv3.common.synchronization [req-90ee57af-1f92-4168-90ed-591247ea5db2 req-c1d67482-f3c6-4888-8d34-f4b0a8581cbd tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 952.454944] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 952.456358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.456358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.456358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.456655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.456655] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.456798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.456798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.456973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.457083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.457264] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.757803] env[62815]: INFO networking_nsxv3.common.synchronization [req-90ee57af-1f92-4168-90ed-591247ea5db2 req-0ded1687-2279-46d8-b52b-2bc260e9e311 tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 952.758256] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 952.758638] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.758748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.916482] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.916674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.916850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.917491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.917852] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.917977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.918060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.918246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.918348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.918451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.918669] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.918787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.918850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.919041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.919552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.919552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 952.919552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.919857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 952.919930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.919979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 952.920311] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.959973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.095557] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 953.095954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.121351] env[62815]: INFO networking_nsxv3.common.synchronization [req-90ee57af-1f92-4168-90ed-591247ea5db2 req-66baf8e1-4f91-4f9e-9a99-dc925422718d tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 953.121996] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 953.122327] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.122426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.425869] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6021d487-9de7-424f-8bb7-283b2180f7a7: rpc.has_security_group_logging(os_id): False [ 953.448328] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.448492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.448578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.448846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.448965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.449245] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.449362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.449456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.449666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.449880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.450016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.450125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.450217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.450384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.450487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.450798] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.450855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.450900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.454160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.454330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.454451] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 953.465468] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.525266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.525432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.525513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.525926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.525926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.545166] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 953.653042] env[62815]: INFO networking_nsxv3.common.synchronization [None req-937ef905-c11d-476a-954e-c000b2a029a3 None None] Enqueued Resource ID: e6a6ec44-846d-46bc-9ff3-92f49d6a93b1 with Priority: HIGHEST for action port [ 953.653420] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a6ec44-846d-46bc-9ff3-92f49d6a93b1 with Priority: HIGHEST for action port [ 953.654364] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6a6ec44-846d-46bc-9ff3-92f49d6a93b1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.654364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6a6ec44-846d-46bc-9ff3-92f49d6a93b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.654364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6a6ec44-846d-46bc-9ff3-92f49d6a93b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.654765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6a6ec44-846d-46bc-9ff3-92f49d6a93b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.654765] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6a6ec44-846d-46bc-9ff3-92f49d6a93b1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.969853] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.971917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.972030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.972379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.972478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 953.972540] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 953.980710] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c6bd812a-bb43-4ef5-8bef-c0ab63359f9f tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 953.981320] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 953.982031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.982031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 953.982031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.983736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 953.983736] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.004836] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.005528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.005672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.005981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.006153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.016829] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 954.113086] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2e9a71aa-4763-4fe8-823a-9a48e3ad3e35 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 954.113086] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 954.113086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.113424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.159718] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6a6ec44-846d-46bc-9ff3-92f49d6a93b1 [ 954.159718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.159718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.159974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.160022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.160125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.160218] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6a6ec44-846d-46bc-9ff3-92f49d6a93b1 already deleted. [ 954.160311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6a6ec44-846d-46bc-9ff3-92f49d6a93b1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.503021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.503411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 954.503411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.504865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.504976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.505100] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b already deleted. [ 954.505199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 954.505369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.505576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 954.505666] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.034224] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.034456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.034564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.034910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.034983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.035154] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b already deleted. [ 955.035294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.516777] env[62815]: INFO networking_nsxv3.common.synchronization [req-4687953c-8a2a-433c-8af7-91036b3e3a5d req-63a8633e-4f02-4538-8254-4971c34d4490 tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_members [ 955.517171] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c580d0c-d242-4267-94c1-b84435b0f93c with Priority: HIGHEST for action security_group_members [ 955.518839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c580d0c-d242-4267-94c1-b84435b0f93c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.518839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.518839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.518839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.518839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.518839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.518839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.519317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.519317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.519512] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c580d0c-d242-4267-94c1-b84435b0f93c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.560439] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 955.560708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.655781] env[62815]: INFO networking_nsxv3.common.synchronization [req-be152881-e23a-4d0b-b0c7-6db8860a925f req-cc79ef1b-088f-4607-a963-04a7c540cd60 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 955.658341] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 955.658341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.658341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.658341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.658341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.658341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.658341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 955.658341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.658341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 955.658732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 955.658732] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.022929] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.022929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.022929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.022929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.028450] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 956.028685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.029051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.029157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.029310] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.029423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.029423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.029650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.029717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.029868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.045235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.045509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.045658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.045712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.045915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.046038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.046092] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c is going to be updated. [ 956.076129] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.076320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.076364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.076941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.076941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.089186] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c580d0c-d242-4267-94c1-b84435b0f93c in Status: IN_PROGRESS for 2s [ 956.162374] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.393896] env[62815]: INFO networking_nsxv3.common.synchronization [None req-0191d419-999e-4139-9061-4e22a6789997 None None] Enqueued Resource ID: 333c6e4f-6fc2-49fc-a864-ee097d01e11f with Priority: HIGHEST for action port [ 956.394199] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333c6e4f-6fc2-49fc-a864-ee097d01e11f with Priority: HIGHEST for action port [ 956.396241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-333c6e4f-6fc2-49fc-a864-ee097d01e11f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.396241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-333c6e4f-6fc2-49fc-a864-ee097d01e11f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.396241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-333c6e4f-6fc2-49fc-a864-ee097d01e11f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.396241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-333c6e4f-6fc2-49fc-a864-ee097d01e11f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.396241] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('333c6e4f-6fc2-49fc-a864-ee097d01e11f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.574161] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.574566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.574566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.574646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.575100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.575100] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.575100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.575100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.575329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.575329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.575442] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 956.603342] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.603342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.603342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.603587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.603587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.614840] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 956.664475] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.899417] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 333c6e4f-6fc2-49fc-a864-ee097d01e11f [ 956.899950] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.899950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 956.899950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.900240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 956.900240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 956.900314] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:333c6e4f-6fc2-49fc-a864-ee097d01e11f already deleted. [ 956.900398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-333c6e4f-6fc2-49fc-a864-ee097d01e11f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.167517] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.169118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.169751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.169990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.169990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.170130] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 957.198721] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.198997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.198997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.199167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.199319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.210518] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 957.828334] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c5c13c-df24-4af8-a93c-704bc1269cf3 req-539a88f7-3dc0-4d72-8208-f4e3ae599177 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 957.828878] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 957.829191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.829321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.829393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.829557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.829734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.829835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 957.829890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.831962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 957.832090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 957.832174] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.100748] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c580d0c-d242-4267-94c1-b84435b0f93c in Status: SUCCESS [ 958.100937] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c580d0c-d242-4267-94c1-b84435b0f93c deletion is rescheduled due to dependency. [ 958.101068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c580d0c-d242-4267-94c1-b84435b0f93c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.281360] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.281568] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.281721] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.282013] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.282850] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.283139] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.283311] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.283579] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.283748] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.284016] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.284203] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.284374] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.284488] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.284611] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.284724] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.284864] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.302699] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.302917] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.303097] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.303281] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.303583] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-cf8cec6a-19bd-4348-805a-172497618afb taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.303759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.303883] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.305141] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.305141] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8cec6a-19bd-4348-805a-172497618afb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.337150] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.337150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.337150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.337299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.337548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.337615] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.337710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.337758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.338049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.338049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.338049] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 958.363649] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.363791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.363857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.364091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.364230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.373720] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 958.624477] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 958.624669] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 deletion is rescheduled due to dependency. [ 958.624784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.624949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.625189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.625375] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.625492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.625556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.625702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.625785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.625876] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.807717] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.808030] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.808123] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.808393] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.809033] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.809033] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port cf8cec6a-19bd-4348-805a-172497618afb not found, creating... [ 958.809033] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.809244] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.809285] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.810045] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.810045] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.810266] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.810375] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.810448] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.810680] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.810828] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.810977] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: cf8cec6a-19bd-4348-805a-172497618afb is going to be created. [ 958.830730] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.830730] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 958.830730] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.830730] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 958.831266] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 958.831266] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.128250] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.128399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.128448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.128682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.132020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.132020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.132020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.132020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.132020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.132020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.132020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 959.155531] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.155735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.155813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.155975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.156140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.163895] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 959.218661] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 959.218874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 959.793582] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c5c13c-df24-4af8-a93c-704bc1269cf3 req-3eb09719-52cf-41cf-999e-775a37f6d11f service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 959.793789] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c5c13c-df24-4af8-a93c-704bc1269cf3 req-3eb09719-52cf-41cf-999e-775a37f6d11f service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 959.793940] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c5c13c-df24-4af8-a93c-704bc1269cf3 req-3eb09719-52cf-41cf-999e-775a37f6d11f service nova] Enqueued Resource ID: cf8cec6a-19bd-4348-805a-172497618afb with Priority: HIGHEST for action port [ 959.794188] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 959.794312] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 959.794405] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf8cec6a-19bd-4348-805a-172497618afb with Priority: HIGHEST for action port [ 959.795049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.795209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.795281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.795450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.795532] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.796329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.796422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.796612] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf8cec6a-19bd-4348-805a-172497618afb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.796709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 959.796771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.796928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 959.796999] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8cec6a-19bd-4348-805a-172497618afb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.298510] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.298872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.300012] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf8cec6a-19bd-4348-805a-172497618afb with status ACTIVE [ 960.300302] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.301474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.301575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.301879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.301979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.302179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.302284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.302346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.302501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.302579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.302765] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.302856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.302917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.303067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.303142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.303226] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf8cec6a-19bd-4348-805a-172497618afb is going to be updated. [ 960.331633] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.331810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.331882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.332107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.332276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.332383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf8cec6a-19bd-4348-805a-172497618afb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.384971] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 960.385167] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 deletion is rescheduled due to dependency. [ 960.385279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.385440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.385655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.385843] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.385958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 960.386029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.386202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 960.386514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 960.386514] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.889582] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.173168] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 961.173349] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 deletion is rescheduled due to dependency. [ 961.173462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.392282] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.895588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.895761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.895829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.896070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.896509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.896509] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 961.923150] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.923296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 961.923367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.923587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 961.923732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 961.935231] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 963.943122] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 963.943122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.943715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.943715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.943883] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.944045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 963.944210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.944390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 963.944497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.944603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 963.944723] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.448691] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.767970] env[62815]: INFO networking_nsxv3.common.synchronization [None req-84c71c40-99a6-4e4f-9bba-4faed44d9a34 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_rules [ 964.768545] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_rules [ 964.768917] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.769051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.771490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.771851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.771956] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.859400] env[62815]: INFO networking_nsxv3.common.synchronization [req-9a975c1e-9cb0-48ea-975d-3ffb434ac59c req-6bacbad6-faa6-45cf-98f0-8452d95d65d0 tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 964.859969] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 964.860268] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.860391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.860514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.861200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.861200] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.861200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.861200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.861200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.861412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.861818] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.951410] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2840bf9-b592-4644-bcf1-bd4ca72a79e5: rpc.has_security_group_logging(os_id): False [ 964.969866] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.969866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.969866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.970637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.970637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.970637] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.970801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 964.971226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.971226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 964.971226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 964.971350] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 964.975775] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e2b12a8f-3d0d-4112-8408-3e4dfce91e74 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_rules [ 964.976417] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_rules [ 964.978320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.978320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.028408] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.029038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.029038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.029038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.029282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.041919] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 965.293119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.293315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.293405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.293696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.293820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.293944] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb already deleted. [ 965.294067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.294368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.294465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.294557] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.365126] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.365589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.365740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.366102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.366296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.366674] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.366877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.367050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.367315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.367454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.367571] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 965.394610] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.395195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.395195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.395340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.395652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.409264] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 965.815881] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.815977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 965.816033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.816262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 965.816354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 965.816452] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb already deleted. [ 965.816532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 966.744547] env[62815]: INFO networking_nsxv3.common.synchronization [None req-94fd0465-b86b-4573-8249-6428e694d555 None None] Enqueued Resource ID: c5ceccdc-d70e-4820-b1dd-58ba914287bb with Priority: HIGHEST for action port [ 966.745057] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ceccdc-d70e-4820-b1dd-58ba914287bb with Priority: HIGHEST for action port [ 966.745427] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ceccdc-d70e-4820-b1dd-58ba914287bb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.745543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ceccdc-d70e-4820-b1dd-58ba914287bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 966.745610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ceccdc-d70e-4820-b1dd-58ba914287bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.745870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ceccdc-d70e-4820-b1dd-58ba914287bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 966.745943] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ceccdc-d70e-4820-b1dd-58ba914287bb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.056817] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 967.057087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.120124] env[62815]: INFO networking_nsxv3.common.synchronization [req-0ad75801-bd7d-4789-9359-3cc62931e3ad req-c4bf2a11-1fd2-4117-bc56-b86021cf0362 tempest-ServerMetadataTestJSON-1536698575 tempest-ServerMetadataTestJSON-1536698575-project-member] Enqueued Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_members [ 967.120663] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_members [ 967.120990] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.121458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.121545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.121855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.122117] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.122235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.122303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.122476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.122576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.122673] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.252901] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5ceccdc-d70e-4820-b1dd-58ba914287bb [ 967.252901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.252901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.252901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.252901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.252901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.252901] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5ceccdc-d70e-4820-b1dd-58ba914287bb already deleted. [ 967.252901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ceccdc-d70e-4820-b1dd-58ba914287bb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.423032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 967.423837] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d deletion is rescheduled due to dependency. [ 967.423837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.625159] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.625337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.625388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.625595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.625692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.625890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.625987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.626056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.626205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.626279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.626361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 already deleted. [ 967.626438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.761457] env[62815]: INFO networking_nsxv3.common.synchronization [None req-dc37b687-32d9-4ff0-8d8d-8b06c807a676 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_rules [ 967.762046] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_rules [ 967.762844] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.762844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.762844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.762844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.763084] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.947712] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.947917] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-876" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.948254] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-876" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.948628] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-876" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.948911] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.949102] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.949229] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.949450] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.949600] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.949833] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.949959] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.950089] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.950213] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.950329] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.951419] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.952763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.957425] env[62815]: INFO networking_nsxv3.common.synchronization [None req-a9b35280-890d-486f-95a6-4c1613fc3026 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_rules [ 967.958188] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_rules [ 967.961479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.961479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.976019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.976019] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.976019] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.976019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-876" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 967.976019] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.976019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 967.976019] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.976401] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 967.976401] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b687fca-cbf2-48fb-887c-8dd9e0bd64f0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.283338] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.283744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.283934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.284569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.284857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.285225] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 already deleted. [ 968.286587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.286587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.286587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.286587] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.479289] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.480269] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.480640] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.481028] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.481227] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.481445] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 not found, creating... [ 968.481666] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.481921] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.482474] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.482772] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.483158] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.483639] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.483847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.483984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.484222] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.484366] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.484834] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 is going to be created. [ 968.503954] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.504279] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.504381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.504596] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.504834] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.505073] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.627325] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c00bd575-3235-48ea-b004-d7c181289814 None None] Enqueued Resource ID: fb8570b6-0e13-465f-9d92-4d8a84765b26 with Priority: HIGHEST for action port [ 968.628711] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb8570b6-0e13-465f-9d92-4d8a84765b26 with Priority: HIGHEST for action port [ 968.628711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb8570b6-0e13-465f-9d92-4d8a84765b26 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.628711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb8570b6-0e13-465f-9d92-4d8a84765b26" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.628711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb8570b6-0e13-465f-9d92-4d8a84765b26" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.629209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb8570b6-0e13-465f-9d92-4d8a84765b26" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.629412] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb8570b6-0e13-465f-9d92-4d8a84765b26',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.805447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.805775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.805775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.805936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.805936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.806515] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 already deleted. [ 968.806515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 968.822169] env[62815]: INFO networking_nsxv3.common.synchronization [None req-21da7f60-6463-4085-b320-b5e353e20215 None None] Enqueued Resource ID: 3c708238-6e2e-4c73-aceb-ac7c7e164ba1 with Priority: HIGHEST for action port [ 968.822746] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c708238-6e2e-4c73-aceb-ac7c7e164ba1 with Priority: HIGHEST for action port [ 968.823090] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c708238-6e2e-4c73-aceb-ac7c7e164ba1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.823208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c708238-6e2e-4c73-aceb-ac7c7e164ba1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.823277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c708238-6e2e-4c73-aceb-ac7c7e164ba1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.823524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c708238-6e2e-4c73-aceb-ac7c7e164ba1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.823603] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c708238-6e2e-4c73-aceb-ac7c7e164ba1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.853274] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5adc4553-1fab-45e5-b0ca-56a7e8234ff3 tempest-ServersTestFqdnHostnames-1151627545 tempest-ServersTestFqdnHostnames-1151627545-project-member] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_rules [ 968.853274] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_rules [ 968.853274] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.853274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 968.853274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.853274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 968.853274] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.066675] env[62815]: INFO networking_nsxv3.common.synchronization [None req-c953b3b6-dcee-493e-986b-c0b8f7b2b9c1 tempest-ServersTestFqdnHostnames-1151627545 tempest-ServersTestFqdnHostnames-1151627545-project-member] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_rules [ 969.067247] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_rules [ 969.067564] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.067667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.132197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb8570b6-0e13-465f-9d92-4d8a84765b26 [ 969.132890] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.132890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.132890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.132890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.132890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.133189] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb8570b6-0e13-465f-9d92-4d8a84765b26 already deleted. [ 969.133189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb8570b6-0e13-465f-9d92-4d8a84765b26" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.327705] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c708238-6e2e-4c73-aceb-ac7c7e164ba1 [ 969.327997] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.329469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.329469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.329469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.329469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.329469] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c708238-6e2e-4c73-aceb-ac7c7e164ba1 already deleted. [ 969.329469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c708238-6e2e-4c73-aceb-ac7c7e164ba1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.375424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.375595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.375925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.375925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.376072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.376072] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 already deleted. [ 969.376314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.376314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.376456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.376541] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.404962] env[62815]: INFO networking_nsxv3.common.synchronization [req-0ad75801-bd7d-4789-9359-3cc62931e3ad req-2b59a72d-c8fa-4d68-ac5c-fd8389a26333 service nova] Enqueued Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_rules [ 969.405068] env[62815]: INFO networking_nsxv3.common.synchronization [req-0ad75801-bd7d-4789-9359-3cc62931e3ad req-2b59a72d-c8fa-4d68-ac5c-fd8389a26333 service nova] Enqueued Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_members [ 969.405197] env[62815]: INFO networking_nsxv3.common.synchronization [req-0ad75801-bd7d-4789-9359-3cc62931e3ad req-2b59a72d-c8fa-4d68-ac5c-fd8389a26333 service nova] Enqueued Resource ID: 9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 with Priority: HIGHEST for action port [ 969.405430] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_rules [ 969.405556] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_members [ 969.405649] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 with Priority: HIGHEST for action port [ 969.406370] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.406532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.406602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.409057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.409057] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.409057] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.409057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.409057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.409057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.409437] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.409437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.409437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.409554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.409554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.409669] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.414998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.414998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.414998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.414998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.414998] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b687fca-cbf2-48fb-887c-8dd9e0bd64f0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.901451] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.901451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.901451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.901451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.901451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.901451] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 already deleted. [ 969.901451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.916812] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.920019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.920198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.920457] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 with status ACTIVE [ 969.920691] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.920827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.920904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.921902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.922466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.922696] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.922963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.922963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.923090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.923194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.923519] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.923519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.923613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.923685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.923765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.923853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b687fca-cbf2-48fb-887c-8dd9e0bd64f0 is going to be updated. [ 969.946398] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.946605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 969.946605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.946895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 969.946982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 969.947515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b687fca-cbf2-48fb-887c-8dd9e0bd64f0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.421037] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.728255] env[62815]: INFO networking_nsxv3.common.synchronization [None req-42dfd953-a87b-467b-8de5-0b59b95385f8 None None] Enqueued Resource ID: 9b067930-8a4c-4443-8b10-04ac84e66474 with Priority: HIGHEST for action port [ 970.728255] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b067930-8a4c-4443-8b10-04ac84e66474 with Priority: HIGHEST for action port [ 970.728255] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b067930-8a4c-4443-8b10-04ac84e66474 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.728255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b067930-8a4c-4443-8b10-04ac84e66474" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.728255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b067930-8a4c-4443-8b10-04ac84e66474" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.728255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b067930-8a4c-4443-8b10-04ac84e66474" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.728255] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b067930-8a4c-4443-8b10-04ac84e66474',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.926083] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.926681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.926681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.926681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.926681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.927597] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 is going to be created. [ 970.952280] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.952430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 970.952566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.952725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 970.952953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 970.962193] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 in Status: UNINITIALIZED for 2s [ 971.230697] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b067930-8a4c-4443-8b10-04ac84e66474 [ 971.232081] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.232081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.232081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.232081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.232081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.232081] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b067930-8a4c-4443-8b10-04ac84e66474 already deleted. [ 971.232081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b067930-8a4c-4443-8b10-04ac84e66474" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 971.929744] env[62815]: INFO networking_nsxv3.common.synchronization [None req-49082d16-b0cb-4ec1-8c0e-77e4e2fd5c10 None None] Enqueued Resource ID: a1a30141-f9e5-4e70-ba21-dd05cee26b06 with Priority: HIGHEST for action port [ 971.930985] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a30141-f9e5-4e70-ba21-dd05cee26b06 with Priority: HIGHEST for action port [ 971.930985] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a30141-f9e5-4e70-ba21-dd05cee26b06 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.930985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a30141-f9e5-4e70-ba21-dd05cee26b06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 971.930985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a30141-f9e5-4e70-ba21-dd05cee26b06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.931471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a30141-f9e5-4e70-ba21-dd05cee26b06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 971.931471] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a30141-f9e5-4e70-ba21-dd05cee26b06',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.248229] env[62815]: INFO networking_nsxv3.common.synchronization [req-028e9d4d-2dfb-498c-b68f-13cfa7242967 req-90301298-4d13-4fc7-9b2f-8d411c1276c2 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 972.248829] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 972.249178] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.249299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.249363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.249564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.249713] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.249815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.249922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.250017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.253421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.253421] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.434577] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1a30141-f9e5-4e70-ba21-dd05cee26b06 [ 972.434805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.435063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.435063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.435220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.435318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.435415] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1a30141-f9e5-4e70-ba21-dd05cee26b06 already deleted. [ 972.435498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a30141-f9e5-4e70-ba21-dd05cee26b06" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.756556] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.756556] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.756556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.756556] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 972.789966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.793633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.793898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.794080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.794284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.804079] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 972.972047] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 in Status: SUCCESS [ 972.972355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.972625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.972771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.972943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.973086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 972.973150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.973316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 972.973415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.973506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 972.973595] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.477372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.477568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.477630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.477875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.478133] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.478259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.478331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.478516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.478624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.478731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.478952] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.479056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.479772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.479772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.479772] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.479772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.479772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.479772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.480129] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.480129] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.480129] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.612249] env[62815]: INFO networking_nsxv3.common.synchronization [req-63610145-615a-4bed-8673-a86a57e4e6bc req-583d796c-fed8-42e3-8475-09556fd6d433 tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 973.613507] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 973.613507] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.613507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.613507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.619400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.619400] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.620641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.620724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.621243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.621243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 973.621243] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.980662] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5b7ccf8f-d09b-4246-8376-50df07f1555f None None] Enqueued Resource ID: a5fcd11d-56b6-4c6f-88cf-495a9be19b12 with Priority: HIGHEST for action port [ 973.980662] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fcd11d-56b6-4c6f-88cf-495a9be19b12 with Priority: HIGHEST for action port [ 973.980662] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5fcd11d-56b6-4c6f-88cf-495a9be19b12 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.980662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5fcd11d-56b6-4c6f-88cf-495a9be19b12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 973.980662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5fcd11d-56b6-4c6f-88cf-495a9be19b12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.980662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5fcd11d-56b6-4c6f-88cf-495a9be19b12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 973.980662] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5fcd11d-56b6-4c6f-88cf-495a9be19b12',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.984629] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0: rpc.has_security_group_logging(os_id): False [ 974.003479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.003676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.003676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.003919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.004123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.004253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.004514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.004761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.004837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.004905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.005137] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.005230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.005374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.005515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.005590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.005774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.005871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.005924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.006234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.006416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.006522] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 is going to be created. [ 974.065582] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.065856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.065856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.066416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.066416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.081417] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 in Status: IN_PROGRESS for 2s [ 974.101160] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.101389] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.101521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.101895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.102845] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.102845] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.102845] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.102845] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.103072] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.103457] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.103599] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.103720] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.103836] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.103967] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.104092] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.104240] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.124038] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.124304] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 974.124463] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.124643] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.124954] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-b0c321a0-d99f-495b-a6e0-8f26c669d8db taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.125430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.125430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.125583] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.126361] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c321a0-d99f-495b-a6e0-8f26c669d8db',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.127023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.127023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.127023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.127023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.127229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.127229] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.127359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.127404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.127518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.127594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.127677] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd already deleted. [ 974.127756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.486965] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5fcd11d-56b6-4c6f-88cf-495a9be19b12 [ 974.487079] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.487249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.488172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.488172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.488172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.488172] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5fcd11d-56b6-4c6f-88cf-495a9be19b12 already deleted. [ 974.488172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5fcd11d-56b6-4c6f-88cf-495a9be19b12" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.618791] env[62815]: INFO networking_nsxv3.common.synchronization [None req-40f89d40-6c5b-4468-8ddc-59cc214b297f tempest-VolumesAdminNegativeTest-1112954704 tempest-VolumesAdminNegativeTest-1112954704-project-member] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_rules [ 974.619638] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_rules [ 974.627473] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.627473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.627473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.627473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.627473] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.628971] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.629192] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.631762] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.633350] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.633350] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.633350] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port b0c321a0-d99f-495b-a6e0-8f26c669d8db not found, creating... [ 974.633350] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.633350] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.633350] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.633704] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.633704] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.634666] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.634881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.635030] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.635300] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.636032] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.636032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: b0c321a0-d99f-495b-a6e0-8f26c669d8db is going to be created. [ 974.656756] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.656901] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.657018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.657334] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 974.657575] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.657813] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 974.742029] env[62815]: INFO networking_nsxv3.common.synchronization [None req-6a50b6c4-7189-4966-9877-5b620cf649c1 tempest-VolumesAdminNegativeTest-1112954704 tempest-VolumesAdminNegativeTest-1112954704-project-member] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_rules [ 974.746043] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_rules [ 974.746043] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.746043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 974.816979] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 974.820192] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 974.820192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.147101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.147448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.147448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.147607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.147786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.147909] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda already deleted. [ 975.148009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.148185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.148377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.148458] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.526272] env[62815]: INFO networking_nsxv3.common.synchronization [req-63610145-615a-4bed-8673-a86a57e4e6bc req-1a0fb184-3e69-4728-840a-f0535e6e243f service nova] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_rules [ 975.526495] env[62815]: INFO networking_nsxv3.common.synchronization [req-63610145-615a-4bed-8673-a86a57e4e6bc req-1a0fb184-3e69-4728-840a-f0535e6e243f service nova] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 975.526607] env[62815]: INFO networking_nsxv3.common.synchronization [req-63610145-615a-4bed-8673-a86a57e4e6bc req-1a0fb184-3e69-4728-840a-f0535e6e243f service nova] Enqueued Resource ID: b0c321a0-d99f-495b-a6e0-8f26c669d8db with Priority: HIGHEST for action port [ 975.526847] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_rules [ 975.526976] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 975.527100] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c321a0-d99f-495b-a6e0-8f26c669d8db with Priority: HIGHEST for action port [ 975.530947] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.530947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.530947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.530947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.530947] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.532354] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.532487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.532547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.532745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.533046] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.533205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.533273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.533469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.533585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.533704] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.534695] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0c321a0-d99f-495b-a6e0-8f26c669d8db taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.534831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.534931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.535143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.535288] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c321a0-d99f-495b-a6e0-8f26c669d8db',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.682115] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.682300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 975.682347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.682550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 975.682640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 975.682737] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda already deleted. [ 975.682818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.033136] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.033136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.036432] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.037601] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0c321a0-d99f-495b-a6e0-8f26c669d8db with status ACTIVE [ 976.037681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.037747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.037799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.038030] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.038119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.038308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.038423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.038471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.038621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.038702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.038963] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.038963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.039106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.039165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.039362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.039362] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0c321a0-d99f-495b-a6e0-8f26c669d8db is going to be updated. [ 976.059602] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.059736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 976.059834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.060022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 976.060175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.060333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0c321a0-d99f-495b-a6e0-8f26c669d8db" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.098189] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 in Status: SUCCESS [ 976.100063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 976.541385] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.043856] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.044064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.044122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.044367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.044470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.044573] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be created. [ 977.064770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.064931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 977.064988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.065608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 977.065608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 977.074834] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: UNINITIALIZED for 2s [ 978.100477] env[62815]: INFO networking_nsxv3.common.synchronization [None req-bc5d94a4-b51b-4990-8b47-7a66e753852f tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_rules [ 978.101039] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_rules [ 978.101353] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.101740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.101740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.101995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.102093] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.174515] env[62815]: INFO networking_nsxv3.common.synchronization [None req-41c260cc-e616-4330-8836-f5db900570eb tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_rules [ 978.175017] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_rules [ 978.175408] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.175555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.622518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.622668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 978.622740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.622968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.623074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.623174] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 already deleted. [ 978.623258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 978.623408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.623635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 978.623635] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.083991] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 979.085118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.085118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.085118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.085118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.085118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.085118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.085437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.085472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.086826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.086826] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.145111] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.145111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.145111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.145111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.145111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.145111] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 already deleted. [ 979.145111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.589893] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.590153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.590216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.590421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.590595] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.590811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.590811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.590914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.591027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.591123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.591274] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.591366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.591441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.591584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.591769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.591951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.591951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.592112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.592187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.592326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.592378] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.887150] env[62815]: INFO networking_nsxv3.common.synchronization [req-688f39f8-650c-4765-bd3b-4effa5506bca req-f1bddd72-8057-479e-954b-168bcb087f74 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 979.887809] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 979.888487] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.888658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.888748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.889051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.889247] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.889392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 979.889547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.889650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 979.889766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 979.889866] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.094527] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd: rpc.has_security_group_logging(os_id): False [ 980.113548] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.113682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.113682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.113983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.113983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.114344] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.114344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.114344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.114494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.114571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.114754] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.114846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.114907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.115059] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.115810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.115810] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.115810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.115810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.115810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.115810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.116094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be created. [ 980.170084] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.170370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.170370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.170513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.170767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.180867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: IN_PROGRESS for 2s [ 980.262247] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.262247] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.262247] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.262453] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.262540] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.262706] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.262839] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.263290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.263472] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.263688] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.263806] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.264555] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.264555] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.264555] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.264555] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.264555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.284784] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.284784] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.284784] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.284784] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.285042] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.285237] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.285361] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.285682] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.285835] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f7ee280-1fc2-493b-a2be-eae8092f6c4c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.374588] env[62815]: INFO networking_nsxv3.common.synchronization [req-59957c83-d597-4f45-8ad6-600b5c66363b req-5b09229e-8bfa-483b-83a1-c91a3b0d8590 tempest-ServersNegativeTestJSON-321560529 tempest-ServersNegativeTestJSON-321560529-project-member] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 980.375595] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGHEST for action security_group_members [ 980.375595] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.375595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.375595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.375815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.375943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.376090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.376190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.376537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.376537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.376537] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.392025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.392163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.392234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.392439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.392526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.392709] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.392828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.392891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.393053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.393135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.393223] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b already deleted. [ 980.393310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.648399] env[62815]: INFO networking_nsxv3.common.synchronization [req-ef190509-7431-42fe-b97b-a55336140928 req-a0546c67-18f2-40ad-97a0-2cc9494e8c07 tempest-ServerMetadataTestJSON-1536698575 tempest-ServerMetadataTestJSON-1536698575-project-member] Enqueued Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_members [ 980.648948] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGHEST for action security_group_members [ 980.649270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.649388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.649452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.649654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.649812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.649913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.649972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.650573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.650675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.650757] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.787800] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.788044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.788185] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.788484] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.788650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.788828] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 7f7ee280-1fc2-493b-a2be-eae8092f6c4c not found, creating... [ 980.789148] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.789322] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.789448] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.789680] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.789837] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.790141] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.790307] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.790429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.790644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.790785] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.790931] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 7f7ee280-1fc2-493b-a2be-eae8092f6c4c is going to be created. [ 980.811053] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.811282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.811413] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.811700] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.811974] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.812222] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.878919] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.879230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.879309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.879536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.879646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.879897] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.879996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.880060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.880258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.880335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.880377] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be updated. [ 980.906745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.906945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 980.906945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.907191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 980.907341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 980.915051] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: IN_PROGRESS for 2s [ 981.155825] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.156091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.156176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.156459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.156568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.156811] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.156927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.156989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.157220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.157293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.157388] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 is going to be updated. [ 981.184869] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.185217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.185217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.185444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.185628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.193770] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 in Status: IN_PROGRESS for 2s [ 981.788324] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e66e0271-ac43-4ca3-8b50-a4e81a344fe4 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_rules [ 981.788324] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_rules [ 981.788324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.788324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.788324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.788324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.789145] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.880966] env[62815]: INFO networking_nsxv3.common.synchronization [None req-00d22788-4742-460e-9cec-dedd48df5489 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_rules [ 981.880966] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_rules [ 981.880966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.880966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.886292] env[62815]: INFO networking_nsxv3.common.synchronization [req-688f39f8-650c-4765-bd3b-4effa5506bca req-a19a980d-e6e9-448f-8515-fb70bef85116 service nova] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 981.888016] env[62815]: INFO networking_nsxv3.common.synchronization [req-688f39f8-650c-4765-bd3b-4effa5506bca req-a19a980d-e6e9-448f-8515-fb70bef85116 service nova] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 981.888016] env[62815]: INFO networking_nsxv3.common.synchronization [req-688f39f8-650c-4765-bd3b-4effa5506bca req-a19a980d-e6e9-448f-8515-fb70bef85116 service nova] Enqueued Resource ID: 7f7ee280-1fc2-493b-a2be-eae8092f6c4c with Priority: HIGHEST for action port [ 981.888016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 981.888016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 981.888016] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f7ee280-1fc2-493b-a2be-eae8092f6c4c with Priority: HIGHEST for action port [ 981.889326] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.889326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.889326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.890046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.890215] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.892215] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.892347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.892412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.892595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.892769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.892881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.892962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.893133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.893219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 981.893311] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.894269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.894756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 981.894878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.895098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 981.895222] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f7ee280-1fc2-493b-a2be-eae8092f6c4c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.192677] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 982.193173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.308412] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.308412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.308839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.308839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.308839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.308935] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df already deleted. [ 982.308935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.309159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.309270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.309343] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.321472] env[62815]: INFO networking_nsxv3.common.synchronization [req-8fd16b45-69ad-4d06-b399-242519f3aea0 req-737ab8c1-557c-4a94-8b58-a5d035b535fe tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 982.321977] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 982.322295] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.322415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.322473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.322665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.322817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.322928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.323014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.323219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.323335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.323431] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.398661] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f7ee280-1fc2-493b-a2be-eae8092f6c4c with status ACTIVE [ 982.398661] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.398661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.398661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.398661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.399159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.402018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.402018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.402018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.402018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f7ee280-1fc2-493b-a2be-eae8092f6c4c is going to be updated. [ 982.402018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.404316] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.404621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.428165] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.428165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.428165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.428165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.428165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.428165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f7ee280-1fc2-493b-a2be-eae8092f6c4c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.670769] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.671010] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.671169] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.671475] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.671765] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.671982] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.672134] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.672381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.672542] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.672767] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.672909] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.673075] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.673223] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.673393] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.673594] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.673842] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.702890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.703094] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 982.703246] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.703426] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.703746] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-09b4955c-0797-4b7d-a713-28de04dfa30f taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.703929] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.704061] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.704443] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.704596] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b4955c-0797-4b7d-a713-28de04dfa30f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.825379] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.833702] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.833832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 982.833908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.834158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 982.834263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.834361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df already deleted. [ 982.834444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 982.909642] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.925822] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 686574a8-1080-450a-a759-40ce406709a1 in Status: SUCCESS [ 982.925822] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 686574a8-1080-450a-a759-40ce406709a1 deletion is rescheduled due to dependency. [ 982.925822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.202922] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 in Status: SUCCESS [ 983.203303] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 deletion is rescheduled due to dependency. [ 983.203303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.206822] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.207089] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.207263] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.207633] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.207843] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.208079] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 09b4955c-0797-4b7d-a713-28de04dfa30f not found, creating... [ 983.208347] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.208543] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.208696] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.208961] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.209167] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.209485] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.209710] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.209854] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.210117] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.210310] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.210479] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 09b4955c-0797-4b7d-a713-28de04dfa30f is going to be created. [ 983.227645] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.227870] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.228052] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.228341] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.228577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.228818] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.327692] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.412704] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.412704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.412704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.412704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.412704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.413083] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be created. [ 983.446138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.446256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.446256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.446450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.446667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.455833] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: UNINITIALIZED for 2s [ 983.829023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.829195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.829262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.829491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.829592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.829679] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be updated. [ 983.890520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.890520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.890520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.890520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.890520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 983.910097] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: IN_PROGRESS for 2s [ 983.956756] env[62815]: INFO networking_nsxv3.common.synchronization [req-8fd16b45-69ad-4d06-b399-242519f3aea0 req-aba0c130-300d-4264-8016-e06ac10b5948 service nova] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_rules [ 983.957123] env[62815]: INFO networking_nsxv3.common.synchronization [req-8fd16b45-69ad-4d06-b399-242519f3aea0 req-aba0c130-300d-4264-8016-e06ac10b5948 service nova] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 983.957331] env[62815]: INFO networking_nsxv3.common.synchronization [req-8fd16b45-69ad-4d06-b399-242519f3aea0 req-aba0c130-300d-4264-8016-e06ac10b5948 service nova] Enqueued Resource ID: 09b4955c-0797-4b7d-a713-28de04dfa30f with Priority: HIGHEST for action port [ 983.957581] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_rules [ 983.957713] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 983.957813] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09b4955c-0797-4b7d-a713-28de04dfa30f with Priority: HIGHEST for action port [ 983.958564] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.958691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.958760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.960777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.961162] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.962100] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.962209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.962411] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-09b4955c-0797-4b7d-a713-28de04dfa30f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.962527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 983.962590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.962776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 983.962892] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b4955c-0797-4b7d-a713-28de04dfa30f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.464805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.465183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.467251] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09b4955c-0797-4b7d-a713-28de04dfa30f with status ACTIVE [ 984.467456] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.467585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.467707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.467860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.467948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.468138] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.468223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.468315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.468428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.468510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.468681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.468773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.468833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.468972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.469066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.469165] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09b4955c-0797-4b7d-a713-28de04dfa30f is going to be updated. [ 984.491024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.491150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.491150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.491342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.491476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.491626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09b4955c-0797-4b7d-a713-28de04dfa30f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.799081] env[62815]: INFO networking_nsxv3.common.synchronization [req-25418d08-6a20-4019-bf2c-928ba4c1b4f9 req-68ec10c7-b792-4797-9b32-40bfe3621f36 tempest-ServerRescueTestJSON-307513274 tempest-ServerRescueTestJSON-307513274-project-member] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 984.799640] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 984.800206] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.800206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.800206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.800522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.800598] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.800681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 984.800762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.800947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 984.801222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 984.801313] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.243639] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.243858] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.243970] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.244316] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.244605] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.244780] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.244911] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.245468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.245572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.245802] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.246219] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.246343] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.246469] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.246775] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.246925] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.247137] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.266280] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.266517] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.266959] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.266959] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-526" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.267440] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-26c62028-1495-46ed-8f97-a7c1feadc73c taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.267440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.267440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.267685] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.267828] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c62028-1495-46ed-8f97-a7c1feadc73c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.304242] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.466589] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 985.466941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.467094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.467317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.467536] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.467744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.467864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.468052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.468319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.469026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.469026] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.770502] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.770754] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.770892] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.771243] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.771373] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.771585] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 26c62028-1495-46ed-8f97-a7c1feadc73c not found, creating... [ 985.771911] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.772120] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.772236] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.772472] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.772623] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.772935] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.773239] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.773387] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.773606] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.773749] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.773896] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 26c62028-1495-46ed-8f97-a7c1feadc73c is going to be created. [ 985.793068] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.793250] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.793374] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.793664] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.793889] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.794137] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.805767] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.921034] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.921034] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 985.921034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 985.921034] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.972664] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.308436] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.308576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.308576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.308801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.308896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.308999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be updated. [ 986.333934] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.334093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.334160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.334382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.334525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.343155] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: IN_PROGRESS for 2s [ 986.422717] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.474584] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fcafbe4-f0ad-4f19-b02b-271988c9904b: rpc.has_security_group_logging(os_id): False [ 986.497395] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.497560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.497637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.497850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.497943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.498224] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.498316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.498384] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.498604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.498604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.498693] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be created. [ 986.573533] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.573712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.573792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.574057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.574276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 986.586836] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 986.696038] env[62815]: INFO networking_nsxv3.common.synchronization [req-25418d08-6a20-4019-bf2c-928ba4c1b4f9 req-8bdc2351-429e-4ce2-b745-aa398886cac5 service nova] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_rules [ 986.696038] env[62815]: INFO networking_nsxv3.common.synchronization [req-25418d08-6a20-4019-bf2c-928ba4c1b4f9 req-8bdc2351-429e-4ce2-b745-aa398886cac5 service nova] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 986.696038] env[62815]: INFO networking_nsxv3.common.synchronization [req-25418d08-6a20-4019-bf2c-928ba4c1b4f9 req-8bdc2351-429e-4ce2-b745-aa398886cac5 service nova] Enqueued Resource ID: 26c62028-1495-46ed-8f97-a7c1feadc73c with Priority: HIGHEST for action port [ 986.696038] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_rules [ 986.696038] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 986.696038] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26c62028-1495-46ed-8f97-a7c1feadc73c with Priority: HIGHEST for action port [ 986.696038] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.696571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.696571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.696571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.696571] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.697269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.697361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.697601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-26c62028-1495-46ed-8f97-a7c1feadc73c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.697668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 986.697706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.697846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 986.697919] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c62028-1495-46ed-8f97-a7c1feadc73c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.926052] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.201308] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26c62028-1495-46ed-8f97-a7c1feadc73c with status ACTIVE [ 987.201308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.201308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.201308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.201308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.201308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.201556] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.201614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.201720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.201822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.201908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.202083] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.202203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.202266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.202408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.202482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.202565] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26c62028-1495-46ed-8f97-a7c1feadc73c is going to be updated. [ 987.203850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.203962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.223785] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.223918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.223964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.224184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.224336] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.224486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26c62028-1495-46ed-8f97-a7c1feadc73c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.429375] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.429535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.429607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.429874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.429969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.430082] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be updated. [ 987.460151] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.460308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 987.460373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.460589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 987.460731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 987.471301] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: IN_PROGRESS for 2s [ 988.352926] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 988.353461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.353461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.353671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.353850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.353969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 988.354055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.354208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 988.354293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.354387] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.601073] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 988.601073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 988.856847] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.359381] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.481438] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 989.481649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.482097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.482097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.482301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.482420] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.482487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.482643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.482729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.482817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.482927] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.861755] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.862250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.862250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.862368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.862368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.862554] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be updated. [ 989.890717] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.890891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.890955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.891141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.891284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.903778] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: IN_PROGRESS for 2s [ 989.986635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.986798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.986878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.987171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.987359] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.987482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.987552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.988477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.988477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.988477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.988477] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.988477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.988477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.988477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.988773] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.988773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 989.988773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.988881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 989.988881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.988969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 989.989081] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.491209] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd: rpc.has_security_group_logging(os_id): False [ 990.511839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.512072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.512149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.512372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.512468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.512695] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.512792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.512854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.513021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.513103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.513834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.513834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.513834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.513834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.513834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.513834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.514183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.514183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.514183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.514183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.514341] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be updated. [ 990.576812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.577083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 990.577136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.577383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 990.577578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 990.589959] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: IN_PROGRESS for 2s [ 991.474503] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 991.474642] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:2 started [ 991.697659] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 991.698073] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 991.913498] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 991.913704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.913872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.914123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.914337] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.914436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 991.914503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.914647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 991.914729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.914821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 991.914954] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.416838] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.417039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.417120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.417334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.417504] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.417598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.417673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.417808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.417900] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.417988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.418171] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.418264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.418316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.418460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.418595] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.418683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.418740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.418876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.418952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.419046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.419135] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.609915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 992.609915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.921092] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7122d614-52b1-4ea3-88d7-21b71b12c2e4: rpc.has_security_group_logging(os_id): False [ 992.941332] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.941478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.941555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.941817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.941916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.942121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.942232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.942295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.942432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.942502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.942690] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.942781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.942834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.942973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.943060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.943301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.943599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 992.943599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.943599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 992.943728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 992.943761] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be updated. [ 993.002210] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.002341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 993.002387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.002593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 993.002739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 993.015211] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: IN_PROGRESS for 2s [ 994.195375] env[62815]: INFO networking_nsxv3.common.synchronization [None req-f290e04b-5fb3-4840-bf19-6d63f9ad4949 tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: bf6e3cab-754e-41ba-8d32-0f403e473fa0 with Priority: HIGHEST for action security_group_rules [ 994.196324] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6e3cab-754e-41ba-8d32-0f403e473fa0 with Priority: HIGHEST for action security_group_rules [ 994.196324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.196659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.196659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.196727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.196766] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6e3cab-754e-41ba-8d32-0f403e473fa0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.290390] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d9bfadf3-4ae0-4547-88fb-55666822916f tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: bf6e3cab-754e-41ba-8d32-0f403e473fa0 with Priority: HIGHEST for action security_group_rules [ 994.290925] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6e3cab-754e-41ba-8d32-0f403e473fa0 with Priority: HIGHEST for action security_group_rules [ 994.291241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.291919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.716176] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.716342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 994.716432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.716986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.716986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.716986] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6e3cab-754e-41ba-8d32-0f403e473fa0 already deleted. [ 994.716986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 994.716986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.717521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 994.717521] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf6e3cab-754e-41ba-8d32-0f403e473fa0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.030074] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 995.030074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.236578] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.236946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 995.236946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.237033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 995.237100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 995.237200] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf6e3cab-754e-41ba-8d32-0f403e473fa0 already deleted. [ 995.237314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf6e3cab-754e-41ba-8d32-0f403e473fa0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.084761] env[62815]: INFO networking_nsxv3.common.synchronization [req-835915a6-341b-439c-9946-b446379c4801 req-0c6bf85e-fed0-4890-b851-f2e54997bcfb tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_members [ 997.085316] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_members [ 997.085631] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.085773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.085947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.086137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.086992] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.086992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.086992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.086992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.086992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.086992] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.482807] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.483035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.483199] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.483604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.483784] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.483947] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.484085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.484308] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.484462] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.484675] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.484796] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.484911] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.485036] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.485156] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.485268] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.485406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.504084] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.504267] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.504433] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.504609] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.504887] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.506053] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.506053] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.506053] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.506053] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.591525] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.591664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.591731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.591899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.592056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.592271] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.592377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 997.592421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.592585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 997.592663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 997.592747] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb already deleted. [ 997.592827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.009552] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.009795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.010000] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.010336] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.010501] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.010764] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b not found, creating... [ 998.011103] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.011304] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.011459] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.011715] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.011887] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.012819] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.013035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.013257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.013597] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.013977] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.014094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b is going to be created. [ 998.035277] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.035519] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.035655] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.035948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.036212] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.036592] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.808356] env[62815]: INFO networking_nsxv3.common.synchronization [req-835915a6-341b-439c-9946-b446379c4801 req-53554e3e-8b02-4d8a-93eb-c96868c958d3 service nova] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_rules [ 998.808648] env[62815]: INFO networking_nsxv3.common.synchronization [req-835915a6-341b-439c-9946-b446379c4801 req-53554e3e-8b02-4d8a-93eb-c96868c958d3 service nova] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_members [ 998.808693] env[62815]: INFO networking_nsxv3.common.synchronization [req-835915a6-341b-439c-9946-b446379c4801 req-53554e3e-8b02-4d8a-93eb-c96868c958d3 service nova] Enqueued Resource ID: c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b with Priority: HIGHEST for action port [ 998.808944] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_rules [ 998.809091] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_members [ 998.809201] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b with Priority: HIGHEST for action port [ 998.809779] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.809924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.809995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.810210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.810292] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.812591] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.812703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.812780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.812944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.813137] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.813252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.813293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.813445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.813623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 998.813623] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.814390] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.817416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 998.817416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.817416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 998.817416] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.317520] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.317636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.317809] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.318575] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b with status ACTIVE [ 999.318786] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.318902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.318970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.319188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.319278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.319445] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.319540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.319600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.319750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.319885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.320093] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.320187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.320254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.320424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.320499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.320584] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b is going to be updated. [ 999.322377] env[62815]: INFO networking_nsxv3.common.synchronization [req-832b9309-5320-4b90-8388-f98427ab611e req-07f28103-4724-4480-8848-d856c6793037 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_members [ 999.323034] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_members [ 999.323769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.323876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.323945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.324179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.324320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.324414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.324476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.324616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.324694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.324779] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.341453] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.341595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.341643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.341808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.341946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.342127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c80ef8f7-7ec5-49fc-b9cc-3dc7490c9f7b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.637018] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-195 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.637018] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.637018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.637839] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.637982] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.638124] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.638250] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.638372] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 999.638487] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.638626] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.656622] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.656792] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 999.657339] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.657552] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.657879] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-d39fec22-9c52-4599-8cd8-6a196dfda918 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.658081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.658215] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.658633] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.658786] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39fec22-9c52-4599-8cd8-6a196dfda918',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.824475] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.826779] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.827142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.827142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.827270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.827947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.827947] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.827947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 999.827947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.827947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 999.827947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 999.828421] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 already deleted. [ 999.828421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.161759] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.162015] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.162175] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.162489] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.162666] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.162831] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port d39fec22-9c52-4599-8cd8-6a196dfda918 not found, creating... [ 1000.163114] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.163282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.163406] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.163654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.163800] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.164098] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.164261] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.164385] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.164598] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.164740] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.164882] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: d39fec22-9c52-4599-8cd8-6a196dfda918 is going to be created. [ 1000.185372] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.185548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.185686] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.185935] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.186205] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.186460] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.327747] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.327747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.327747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.327952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.328028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.328069] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb is going to be created. [ 1000.354351] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.354501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.354546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.354753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.354916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.365710] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: UNINITIALIZED for 2s [ 1000.952944] env[62815]: INFO networking_nsxv3.common.synchronization [req-832b9309-5320-4b90-8388-f98427ab611e req-e43992f9-c178-497c-ad2b-4f5721ce83ed service nova] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_rules [ 1000.953273] env[62815]: INFO networking_nsxv3.common.synchronization [req-832b9309-5320-4b90-8388-f98427ab611e req-e43992f9-c178-497c-ad2b-4f5721ce83ed service nova] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_members [ 1000.953324] env[62815]: INFO networking_nsxv3.common.synchronization [req-832b9309-5320-4b90-8388-f98427ab611e req-e43992f9-c178-497c-ad2b-4f5721ce83ed service nova] Enqueued Resource ID: d39fec22-9c52-4599-8cd8-6a196dfda918 with Priority: HIGHEST for action port [ 1000.953549] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_rules [ 1000.953683] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_members [ 1000.953781] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39fec22-9c52-4599-8cd8-6a196dfda918 with Priority: HIGHEST for action port [ 1000.954377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.954509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.954573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.955177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.955177] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.958924] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.959108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.959175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.959691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.959691] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.959860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.959860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.960075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.960195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1000.960318] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.962182] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39fec22-9c52-4599-8cd8-6a196dfda918 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.962340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1000.962482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.962675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1000.962776] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39fec22-9c52-4599-8cd8-6a196dfda918',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.464789] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d39fec22-9c52-4599-8cd8-6a196dfda918 with status ACTIVE [ 1001.465034] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.465188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.465261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.465477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.465572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.465939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.465939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.465939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.466119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.466119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.466301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.466395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.466452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.466590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.466686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.466741] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d39fec22-9c52-4599-8cd8-6a196dfda918 is going to be updated. [ 1001.467945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.468424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.468655] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.517208] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.517403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.517403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.517621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.517758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.517912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39fec22-9c52-4599-8cd8-6a196dfda918" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.918177] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a889162-184d-4e6c-ad28-adae156cc317 req-a864fc0c-a0c0-4579-add4-bfb5deabf859 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 1001.918807] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 1001.919152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.919281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.919417] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.919558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.919710] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.919805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1001.920019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.920019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1001.920222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1001.920222] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.972019] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.377801] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: SUCCESS [ 1002.378170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.378170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.378557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.378557] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.378696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.378767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.378881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.378965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.379065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.379157] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.423997] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.425027] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.425027] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.425027] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.425027] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.425282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.425331] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.425556] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.425711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.425932] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.426062] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.426222] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.426347] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.426469] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.426579] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.426717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.427857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.428073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.428073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.428207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.428300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.428483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.428574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.428631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.428776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.428849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.428934] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 1002.448507] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.448687] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.448858] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.449166] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-530" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.449399] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.449586] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.449714] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.450095] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.450248] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad80d9c-2963-4e8e-af2d-4237fbe498e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.453965] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.453965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.453965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.453965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.453965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.467554] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 1002.474195] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.474494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.475060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.476244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.476794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.477174] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 is going to be created. [ 1002.503407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.503561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.503632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.503854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.504025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.513523] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97bb76de-5dc3-4e83-aabb-986627b27731 in Status: UNINITIALIZED for 2s [ 1002.884906] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.952601] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.952822] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.953026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.953361] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.953524] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.953690] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 4ad80d9c-2963-4e8e-af2d-4237fbe498e8 not found, creating... [ 1002.954851] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.954851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.954851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.954851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.954851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.955267] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.955267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.955267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.955537] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.955691] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.955839] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 4ad80d9c-2963-4e8e-af2d-4237fbe498e8 is going to be created. [ 1002.977174] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.977479] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1002.977611] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.977922] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1002.978298] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1002.978604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.387643] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7acd52f-0ca6-446a-a4c8-68abd06e46eb: rpc.has_security_group_logging(os_id): False [ 1003.405106] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.405285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.405365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.405596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.405688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.405951] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.406070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.406137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.406323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.406416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.406543] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb is going to be created. [ 1003.462584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.462780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1003.462780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.463023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1003.463198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1003.473279] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: IN_PROGRESS for 2s [ 1004.172746] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a889162-184d-4e6c-ad28-adae156cc317 req-75f4c8fe-48e5-4c0b-ad88-02f811f34ffc service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 1004.173058] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a889162-184d-4e6c-ad28-adae156cc317 req-75f4c8fe-48e5-4c0b-ad88-02f811f34ffc service nova] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 1004.173058] env[62815]: INFO networking_nsxv3.common.synchronization [req-8a889162-184d-4e6c-ad28-adae156cc317 req-75f4c8fe-48e5-4c0b-ad88-02f811f34ffc service nova] Enqueued Resource ID: 4ad80d9c-2963-4e8e-af2d-4237fbe498e8 with Priority: HIGHEST for action port [ 1004.173511] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_rules [ 1004.173638] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 1004.174029] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ad80d9c-2963-4e8e-af2d-4237fbe498e8 with Priority: HIGHEST for action port [ 1004.174122] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.174348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.174432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.174647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.174725] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.177025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.177025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.177025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.177025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.177025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.177025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.177025] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad80d9c-2963-4e8e-af2d-4237fbe498e8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.477467] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 1004.477467] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.477467] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.477467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.477467] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.522289] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97bb76de-5dc3-4e83-aabb-986627b27731 in Status: SUCCESS [ 1004.522289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.522406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.522631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.522819] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.522950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.523055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.523265] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.523396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.523454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.523528] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.579437] env[62815]: INFO networking_nsxv3.common.synchronization [req-fda06acf-4167-42de-b9b0-054d7a253fba req-6c1204b3-72c4-47bf-8741-675719651450 tempest-ServersTestFqdnHostnames-1151627545 tempest-ServersTestFqdnHostnames-1151627545-project-member] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_members [ 1004.580024] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_members [ 1004.580335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.580455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.580519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.580786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.580944] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.581813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.581813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.581946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.582104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.583066] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.676591] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.676736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.679301] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ad80d9c-2963-4e8e-af2d-4237fbe498e8 with status ACTIVE [ 1004.679563] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.679700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.679770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.680020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.680119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.680309] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.680425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.680485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.681404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.681491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.681688] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.681784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.681845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.682200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.682290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.682736] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ad80d9c-2963-4e8e-af2d-4237fbe498e8 is going to be updated. [ 1004.704263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.704413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.704459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.704803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.704803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.705228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ad80d9c-2963-4e8e-af2d-4237fbe498e8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.979767] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.990218] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.990573] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-531" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.990937] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-531" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.991576] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-531" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.991850] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.992194] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1004.992738] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.993110] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1004.993395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1004.993792] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.994294] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.994294] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.994294] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.994472] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.994511] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.994676] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.013791] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.013979] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1005.014132] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.014371] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-531" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.014697] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-8e3e3bc6-a050-441d-8320-5f090a64f658 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.014881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.015016] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.015865] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.016186] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3e3bc6-a050-441d-8320-5f090a64f658',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.026908] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.085858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.086041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.086109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.086350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.086447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.086657] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.086790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.086857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.087024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.087106] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.087228] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 already deleted. [ 1005.087321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.482431] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.486668] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: SUCCESS [ 1005.486937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.519820] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.520225] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.520440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.520826] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.521381] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.521381] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 8e3e3bc6-a050-441d-8320-5f090a64f658 not found, creating... [ 1005.521752] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.522042] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.522247] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.522502] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.522651] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.522983] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.523167] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.523286] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.523499] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.523917] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.523917] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 8e3e3bc6-a050-441d-8320-5f090a64f658 is going to be created. [ 1005.531065] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97bb76de-5dc3-4e83-aabb-986627b27731: rpc.has_security_group_logging(os_id): False [ 1005.544538] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.544771] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.544903] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.545326] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.545544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.545775] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.547153] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.547268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.547327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.547493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.547572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.547787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.547881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.547943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.548096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.548175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.548259] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 is going to be created. [ 1005.669402] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.669402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.669402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.669622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.669807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.679535] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97bb76de-5dc3-4e83-aabb-986627b27731 in Status: IN_PROGRESS for 2s [ 1005.985398] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.985398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1005.985398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.985636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1005.985636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1005.985757] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 1006.013194] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.013194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.013194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.013436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.013568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.024098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 1006.924435] env[62815]: INFO networking_nsxv3.common.synchronization [req-fda06acf-4167-42de-b9b0-054d7a253fba req-c5e9e111-2805-4664-9596-9a0cb74594f5 service nova] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_rules [ 1006.924651] env[62815]: INFO networking_nsxv3.common.synchronization [req-fda06acf-4167-42de-b9b0-054d7a253fba req-c5e9e111-2805-4664-9596-9a0cb74594f5 service nova] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_members [ 1006.924696] env[62815]: INFO networking_nsxv3.common.synchronization [req-fda06acf-4167-42de-b9b0-054d7a253fba req-c5e9e111-2805-4664-9596-9a0cb74594f5 service nova] Enqueued Resource ID: 8e3e3bc6-a050-441d-8320-5f090a64f658 with Priority: HIGHEST for action port [ 1006.924993] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_rules [ 1006.925158] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_members [ 1006.925270] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e3e3bc6-a050-441d-8320-5f090a64f658 with Priority: HIGHEST for action port [ 1006.925827] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.925966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.927520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.927520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.927520] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.928835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.929040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.929153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.929366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.929562] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.929715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.929818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.930044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.930186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1006.930316] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.934770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e3e3bc6-a050-441d-8320-5f090a64f658 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.934890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1006.934940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.935112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1006.935193] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e3e3bc6-a050-441d-8320-5f090a64f658',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.281236] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-7445e5a7-335e-4108-9d4e-fa8bec56f712 tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1007.281603] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1007.281911] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.282252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.282252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.282352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.282484] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.283423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.283423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.283423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.283423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.283423] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.435143] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.436205] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.436353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.440320] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e3e3bc6-a050-441d-8320-5f090a64f658 with status ACTIVE [ 1007.440544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.440680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.440750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.440997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.441178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.441323] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.441457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.441537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.441711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.441903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.442056] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.442170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.442237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.442407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.442502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.442628] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e3e3bc6-a050-441d-8320-5f090a64f658 is going to be updated. [ 1007.464133] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.464464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.464585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.464858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.465037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.465321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e3e3bc6-a050-441d-8320-5f090a64f658" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.698048] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97bb76de-5dc3-4e83-aabb-986627b27731 in Status: SUCCESS [ 1007.698048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.766607] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-b817ed37-df56-41a0-b122-ea83464afde3 tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1007.767208] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1007.767531] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.767637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.785324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.785560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.785560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.785748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.785840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.786057] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.786156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.786218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.786372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.786448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.786537] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1007.813057] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.813240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1007.813289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.813560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1007.813729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1007.824798] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1007.941061] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.033444] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 1008.034691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.034691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.034691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.034691] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.034691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.034924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.034952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.035099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.035249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.035285] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.411234] env[62815]: INFO networking_nsxv3.common.synchronization [req-ecb68876-b885-4686-ac8c-21a1ff6384df req-f597e8aa-b73d-4647-99bb-8a5e81d3a7f0 tempest-ServersV294TestFqdnHostnames-377829194 tempest-ServersV294TestFqdnHostnames-377829194-project-member] Enqueued Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_members [ 1008.411234] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd with Priority: HIGHEST for action security_group_members [ 1008.411234] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f996b59-23a9-402b-8f9c-3e070b4b44dd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.411436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.411436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.411606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.411754] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.411888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.411957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.415582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.415709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.416351] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f996b59-23a9-402b-8f9c-3e070b4b44dd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.446197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.446197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.446197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.446197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.446197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.446197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 is going to be created. [ 1008.465852] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.466150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.466150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.466270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.466452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.475307] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 in Status: UNINITIALIZED for 2s [ 1008.538516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.538733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.538871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.539104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.539330] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.539460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.539546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.540547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.540671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.540776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.541043] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.541172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.541234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.541624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.541774] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.542224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.542224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.542224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.542374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.542412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.542739] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.567179] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.567724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-460" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.567906] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-460" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.568412] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-460" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.569268] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.569564] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.569725] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.570509] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.570768] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.573850] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.573850] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.573850] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.573850] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.574090] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.574090] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.574184] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.596555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.596775] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.596889] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.597096] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-460" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.597457] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-2e643784-b0b7-4d52-b410-582b18fd5e00 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.597653] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.597805] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.598179] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.598330] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e643784-b0b7-4d52-b410-582b18fd5e00',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.918848] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.918848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.918848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.920373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.920373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.920373] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.920373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.920373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.920632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.920822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.920994] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd is going to be updated. [ 1008.948452] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.949992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1008.949992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.949992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1008.949992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1008.958457] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd in Status: IN_PROGRESS for 2s [ 1009.045719] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95315c29-36f4-4fb3-afae-f96b062c5650: rpc.has_security_group_logging(os_id): False [ 1009.070422] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.070422] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.070422] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.070422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.070927] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.070927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.070927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.070927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.070927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.070927] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 1009.104023] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.104023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 2e643784-b0b7-4d52-b410-582b18fd5e00 not found, creating... [ 1009.104023] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.104023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.104544] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.104544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.104544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.104817] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.105096] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.105369] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 2e643784-b0b7-4d52-b410-582b18fd5e00 is going to be created. [ 1009.122243] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.129024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.129024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.129473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.129535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.142865] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 1009.839203] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1009.839203] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 deletion is rescheduled due to dependency. [ 1009.839203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.839203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.839203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.839749] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.840021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1009.840208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.840457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1009.841415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1009.841491] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.344018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.484894] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 in Status: SUCCESS [ 1010.485067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.485229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.485452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.485642] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.485757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.485931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.485981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.486063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.486152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.486241] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.568413] env[62815]: INFO networking_nsxv3.common.synchronization [req-bf6ad547-9c26-41e2-a3ce-d97da673803f req-bb6f2ff1-f672-4732-9d65-8f68cd057454 tempest-VolumesAdminNegativeTest-1112954704 tempest-VolumesAdminNegativeTest-1112954704-project-member] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_members [ 1010.568413] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_members [ 1010.568413] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.568646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.568646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.568967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.569022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.569432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1010.569496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.569662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1010.569750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.569842] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.845987] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.967726] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd in Status: SUCCESS [ 1010.967910] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f996b59-23a9-402b-8f9c-3e070b4b44dd deletion is rescheduled due to dependency. [ 1010.968039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f996b59-23a9-402b-8f9c-3e070b4b44dd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1010.988425] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.073320] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.073516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.073621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.073872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.073999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.074219] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.074386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.074499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.074698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.074778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.074867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda already deleted. [ 1011.074961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.157068] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 1011.157332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.182285] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-feb42a35-5aa3-40c4-a680-73deb815966c service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 1011.182471] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-feb42a35-5aa3-40c4-a680-73deb815966c service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1011.182629] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-feb42a35-5aa3-40c4-a680-73deb815966c service nova] Enqueued Resource ID: 2e643784-b0b7-4d52-b410-582b18fd5e00 with Priority: HIGHEST for action port [ 1011.182865] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 1011.182991] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1011.183154] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e643784-b0b7-4d52-b410-582b18fd5e00 with Priority: HIGHEST for action port [ 1011.183717] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.183842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.183910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.184754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.184842] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.186185] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.186286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.186495] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e643784-b0b7-4d52-b410-582b18fd5e00 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.186605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.186710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.186843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.186916] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e643784-b0b7-4d52-b410-582b18fd5e00',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.348557] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.348895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.348895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.349099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.349203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.349306] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1011.397075] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.397075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.397162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.397316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.397447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.406663] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1011.492398] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 660d9a55-7b14-45fd-8919-bb2ac822b971: rpc.has_security_group_logging(os_id): False [ 1011.512504] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.512504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.512504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.516024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.516024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.516024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.516024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.516024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.516024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.516024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.516024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 is going to be created. [ 1011.587351] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.587351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.587351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.587803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.588502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.602026] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 in Status: IN_PROGRESS for 2s [ 1011.685473] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.685643] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.685781] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.686084] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.686356] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.686525] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.686648] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.686874] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.687646] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.687646] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.687646] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.688538] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.688538] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.688538] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.688538] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.688538] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.692964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.693146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.693278] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e643784-b0b7-4d52-b410-582b18fd5e00 with status ACTIVE [ 1011.693474] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.693584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.693694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.693916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.694035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.694242] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.694386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.694619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.694796] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.694948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.695103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.695181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.695263] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e643784-b0b7-4d52-b410-582b18fd5e00 is going to be updated. [ 1011.713943] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.714141] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1011.714296] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.714757] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.715312] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-92ae358d-4b7f-421a-bf14-e2090754bffb taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.715835] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.716070] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.716382] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.716530] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92ae358d-4b7f-421a-bf14-e2090754bffb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.718052] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.718177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1011.718249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.718423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1011.718551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1011.718698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e643784-b0b7-4d52-b410-582b18fd5e00" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.221048] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.221491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.222219] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.222604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.222823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.222966] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 92ae358d-4b7f-421a-bf14-e2090754bffb not found, creating... [ 1012.223406] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.223527] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.223583] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.223873] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.224099] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.224287] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.224489] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.224628] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.224860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.225016] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.225211] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 92ae358d-4b7f-421a-bf14-e2090754bffb is going to be created. [ 1012.261521] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.261521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.261521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.261521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.261521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.261521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.412984] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.412984] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-953" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.414092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-953" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.414092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-953" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.414092] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.414092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.414447] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.415480] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.415480] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.415480] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.415480] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.415480] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.415480] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.415862] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.415934] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.416176] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.439438] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.439611] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.439750] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.440023] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-953" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.440421] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.440610] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.441734] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.441734] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.441734] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd62f9ed-28c7-49f2-ae5b-b06708e2f097',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.453036] env[62815]: INFO networking_nsxv3.common.synchronization [req-a5bce925-ff71-4eb2-bc0c-b1d82cfc78b2 req-2ab02df7-4f4b-46a3-a62d-73f550dbd013 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1012.453284] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1012.453745] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.453884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.453956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.454229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.454321] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.454502] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.454595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.454719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.454858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.454918] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.947566] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.947823] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.947960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.948281] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.948443] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.948608] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port dd62f9ed-28c7-49f2-ae5b-b06708e2f097 not found, creating... [ 1012.948878] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.949056] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.949184] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.949407] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.949548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.949835] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.949987] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.950135] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.950342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.950479] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.950621] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: dd62f9ed-28c7-49f2-ae5b-b06708e2f097 is going to be created. [ 1012.958859] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.971616] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.971800] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.971921] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.972304] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.972543] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.972766] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.982633] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.982820] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.982949] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.983222] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.983484] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.983644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1012.983767] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.983976] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1012.984575] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1012.984798] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.985088] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.985225] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.985361] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.985599] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.985942] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.986141] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.005630] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.005630] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.005630] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.005630] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.005630] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-85e43041-6d5c-45f7-9d0c-f211920eb42e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.005793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.005825] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.006149] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.006290] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e43041-6d5c-45f7-9d0c-f211920eb42e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.106600] env[62815]: INFO networking_nsxv3.common.synchronization [req-bf6ad547-9c26-41e2-a3ce-d97da673803f req-12eedb71-b335-4c83-b740-297705f7647d service nova] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_rules [ 1013.106784] env[62815]: INFO networking_nsxv3.common.synchronization [req-bf6ad547-9c26-41e2-a3ce-d97da673803f req-12eedb71-b335-4c83-b740-297705f7647d service nova] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_members [ 1013.106980] env[62815]: INFO networking_nsxv3.common.synchronization [req-bf6ad547-9c26-41e2-a3ce-d97da673803f req-12eedb71-b335-4c83-b740-297705f7647d service nova] Enqueued Resource ID: 92ae358d-4b7f-421a-bf14-e2090754bffb with Priority: HIGHEST for action port [ 1013.107880] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_rules [ 1013.108046] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_members [ 1013.108323] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92ae358d-4b7f-421a-bf14-e2090754bffb with Priority: HIGHEST for action port [ 1013.109206] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.109364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.109459] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.109678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.109789] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.111180] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.111180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.111255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.111521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.112693] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.112693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.112693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.112693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.112693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.112693] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.113672] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-92ae358d-4b7f-421a-bf14-e2090754bffb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.113790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.113845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.114051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.114132] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92ae358d-4b7f-421a-bf14-e2090754bffb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.416551] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1013.416551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.416929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.419370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.419370] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.419370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.419370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.419370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.419370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.419370] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.464767] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.510632] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.510632] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.510632] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.514035] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 85e43041-6d5c-45f7-9d0c-f211920eb42e not found, creating... [ 1013.514035] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.514035] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.514035] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.514457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.514457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.514457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.514457] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 85e43041-6d5c-45f7-9d0c-f211920eb42e is going to be created. [ 1013.531629] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.531854] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.531980] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.532336] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.532570] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.532793] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.612151] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 in Status: SUCCESS [ 1013.612360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.612713] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.612815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.614483] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.615309] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92ae358d-4b7f-421a-bf14-e2090754bffb with status ACTIVE [ 1013.615509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.615624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.615691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.617094] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.617094] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.617094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.617094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92ae358d-4b7f-421a-bf14-e2090754bffb is going to be updated. [ 1013.639160] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.639274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.639522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.639920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.640062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.640291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92ae358d-4b7f-421a-bf14-e2090754bffb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.924283] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.971273] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.971273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1013.971273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.971273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1013.971273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1013.971273] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1014.016660] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.017328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.017328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.017466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.017585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.026256] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1014.119041] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.220266] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-228cda9d-bf35-4a18-b50e-05d524d67069 service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 1014.220593] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-228cda9d-bf35-4a18-b50e-05d524d67069 service nova] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1014.220840] env[62815]: INFO networking_nsxv3.common.synchronization [req-4ded43b2-05dc-4b5f-a680-99dd35703af7 req-228cda9d-bf35-4a18-b50e-05d524d67069 service nova] Enqueued Resource ID: dd62f9ed-28c7-49f2-ae5b-b06708e2f097 with Priority: HIGHEST for action port [ 1014.221669] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_rules [ 1014.221829] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1014.221915] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd62f9ed-28c7-49f2-ae5b-b06708e2f097 with Priority: HIGHEST for action port [ 1014.222390] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.222513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.222787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.222914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.223187] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.223343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.223431] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.223691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.223799] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd62f9ed-28c7-49f2-ae5b-b06708e2f097',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.426047] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.624729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.624906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.624958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.625205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.625333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.625473] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda is going to be created. [ 1014.648832] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.648982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.649065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.649296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.649475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.658513] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: UNINITIALIZED for 2s [ 1014.725619] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd62f9ed-28c7-49f2-ae5b-b06708e2f097 with status ACTIVE [ 1014.725870] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.726013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.726101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.726360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.726460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.726654] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.726756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.726819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.726973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.727064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.727249] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.727351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.727455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.727652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.727732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.727819] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd62f9ed-28c7-49f2-ae5b-b06708e2f097 is going to be updated. [ 1014.765787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.765932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.765985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.766223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.766366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.766523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd62f9ed-28c7-49f2-ae5b-b06708e2f097" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.933173] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.933173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.933173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.933173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.933173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.933173] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1014.965502] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.965681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1014.965778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.966064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1014.966302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1014.975307] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1015.086056] env[62815]: INFO networking_nsxv3.common.synchronization [req-99edb8e4-5bf9-4d9d-a944-e4539d34896d req-1ee76728-2557-4ba1-a8b5-0d1b97c5222f tempest-ServerRescueTestJSON-307513274 tempest-ServerRescueTestJSON-307513274-project-member] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 1015.086658] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 1015.087288] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.087288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.087288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.087449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.087554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.087621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.087661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.087860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.087967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.088058] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.123859] env[62815]: INFO networking_nsxv3.common.synchronization [req-a5bce925-ff71-4eb2-bc0c-b1d82cfc78b2 req-552f4556-91ae-406c-b350-7cc59d822dae service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 1015.124067] env[62815]: INFO networking_nsxv3.common.synchronization [req-a5bce925-ff71-4eb2-bc0c-b1d82cfc78b2 req-552f4556-91ae-406c-b350-7cc59d822dae service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1015.124224] env[62815]: INFO networking_nsxv3.common.synchronization [req-a5bce925-ff71-4eb2-bc0c-b1d82cfc78b2 req-552f4556-91ae-406c-b350-7cc59d822dae service nova] Enqueued Resource ID: 85e43041-6d5c-45f7-9d0c-f211920eb42e with Priority: HIGHEST for action port [ 1015.125502] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 1015.125940] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1015.125940] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e43041-6d5c-45f7-9d0c-f211920eb42e with Priority: HIGHEST for action port [ 1015.126830] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.126952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.127029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.127261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.127363] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.128284] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.128385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.128591] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-85e43041-6d5c-45f7-9d0c-f211920eb42e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.128746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.128746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.128942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.128977] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e43041-6d5c-45f7-9d0c-f211920eb42e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.592893] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.634032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.634032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85e43041-6d5c-45f7-9d0c-f211920eb42e with status ACTIVE [ 1015.634032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.634032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.634032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.634032] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.634779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.634779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.634779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.634779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.634779] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85e43041-6d5c-45f7-9d0c-f211920eb42e is going to be updated. [ 1015.655533] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.655533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1015.655533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.655533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1015.655533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1015.655533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85e43041-6d5c-45f7-9d0c-f211920eb42e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.035410] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1016.036514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.036875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.037280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.037578] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.039054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.039054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.039054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.039054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.039054] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.095847] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.267677] env[62815]: INFO networking_nsxv3.common.synchronization [req-3e965fed-6eb9-4db4-aa4c-736aaa9b1480 req-87450364-7922-4398-9977-a19e82e8565f tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_members [ 1016.268255] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_members [ 1016.268593] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.268715] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.268761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.270759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.270759] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.270759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.270759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.270759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.270759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.270759] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.542363] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.600560] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.600892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.600892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.602101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.602101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.602101] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be updated. [ 1016.631509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.631618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.631700] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.631917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.632107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.641357] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: IN_PROGRESS for 2s [ 1016.668853] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: UNINITIALIZED for 4s [ 1016.774722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.774722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.774722] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 already deleted. [ 1016.774722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.816849] env[62815]: INFO networking_nsxv3.common.synchronization [None req-38a58128-aa87-4eb7-9a8b-57335b392d82 None None] Enqueued Resource ID: fbd98ff6-5532-40ce-8568-509c1fc54d23 with Priority: HIGHEST for action port [ 1016.817597] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbd98ff6-5532-40ce-8568-509c1fc54d23 with Priority: HIGHEST for action port [ 1016.818058] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbd98ff6-5532-40ce-8568-509c1fc54d23 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.818299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbd98ff6-5532-40ce-8568-509c1fc54d23" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.818340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbd98ff6-5532-40ce-8568-509c1fc54d23" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.818777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbd98ff6-5532-40ce-8568-509c1fc54d23" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.820007] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbd98ff6-5532-40ce-8568-509c1fc54d23',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.871497] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.871649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.871649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.871919] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.872297] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.872452] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.872556] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.872786] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.873011] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.874435] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.874691] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.874946] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.874946] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.875201] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.875394] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.875562] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.893949] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.895201] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.895397] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.895590] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-628" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.895956] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.896163] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.896295] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.896625] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.896768] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dc7ae46-ec5d-4930-abc1-caf23c0f66ac',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.987155] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.987155] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.987155] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.987155] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.987545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.987807] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.988022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1016.988259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.988498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1016.988653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1016.988803] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.044393] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.323216] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbd98ff6-5532-40ce-8568-509c1fc54d23 [ 1017.323216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.323216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.323216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.323216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.323216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.323216] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbd98ff6-5532-40ce-8568-509c1fc54d23 already deleted. [ 1017.323216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbd98ff6-5532-40ce-8568-509c1fc54d23" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.400030] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.400030] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.400030] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.400822] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.400822] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.400980] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 7dc7ae46-ec5d-4930-abc1-caf23c0f66ac not found, creating... [ 1017.401212] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.401669] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.401814] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.402132] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.402316] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.402643] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.402849] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.403009] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.403300] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.403468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.403620] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 7dc7ae46-ec5d-4930-abc1-caf23c0f66ac is going to be created. [ 1017.423959] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.425895] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.426240] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.426701] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.427273] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.427663] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.491161] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.491365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.491545] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.547597] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.547597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.547597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.547822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.548107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.548107] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1017.586179] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.586729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1017.586947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.587184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1017.587926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1017.605911] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1017.993563] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.499466] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.499918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.499918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.502170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.502170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.502170] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1018.532553] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.532794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.532794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.532996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.533181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.543150] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1018.655224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 1018.655544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.681219] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: SUCCESS [ 1018.681339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.681710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.681783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.681945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.682114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.682192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.682360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.682438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.682524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.682611] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.893311] env[62815]: INFO networking_nsxv3.common.synchronization [req-3e965fed-6eb9-4db4-aa4c-736aaa9b1480 req-face32e1-e4e5-478f-a531-1f732b0cd3e9 service nova] Enqueued Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_rules [ 1018.893522] env[62815]: INFO networking_nsxv3.common.synchronization [req-3e965fed-6eb9-4db4-aa4c-736aaa9b1480 req-face32e1-e4e5-478f-a531-1f732b0cd3e9 service nova] Enqueued Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_members [ 1018.893745] env[62815]: INFO networking_nsxv3.common.synchronization [req-3e965fed-6eb9-4db4-aa4c-736aaa9b1480 req-face32e1-e4e5-478f-a531-1f732b0cd3e9 service nova] Enqueued Resource ID: 7dc7ae46-ec5d-4930-abc1-caf23c0f66ac with Priority: HIGHEST for action port [ 1018.894358] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_rules [ 1018.894507] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_members [ 1018.894608] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc7ae46-ec5d-4930-abc1-caf23c0f66ac with Priority: HIGHEST for action port [ 1018.894916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.895054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.895151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.895420] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.895528] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.896560] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.896684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.896757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.896952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.897216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.897321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.897375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.897530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.897621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1018.898338] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.898834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.898895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.898923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.899655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.899750] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dc7ae46-ec5d-4930-abc1-caf23c0f66ac',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.915496] env[62815]: INFO networking_nsxv3.common.synchronization [None req-08ce5277-7680-4d27-a05b-336ae5051c69 None None] Enqueued Resource ID: eebcf594-4c7c-47d0-be40-4978b776cc9f with Priority: HIGHEST for action port [ 1018.916304] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eebcf594-4c7c-47d0-be40-4978b776cc9f with Priority: HIGHEST for action port [ 1018.918953] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-eebcf594-4c7c-47d0-be40-4978b776cc9f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.918953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eebcf594-4c7c-47d0-be40-4978b776cc9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1018.918953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eebcf594-4c7c-47d0-be40-4978b776cc9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.918953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eebcf594-4c7c-47d0-be40-4978b776cc9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1018.918953] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eebcf594-4c7c-47d0-be40-4978b776cc9f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.094050] env[62815]: INFO networking_nsxv3.common.synchronization [req-249ce67b-6d51-4880-8043-b29dc6c8ac12 req-cefc7dcd-3de8-4951-b382-aa55f74e2f66 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_members [ 1019.094913] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_members [ 1019.095343] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.095488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.095573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.096210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.096425] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.096575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.096659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.096858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.096970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.097191] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.187306] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.401812] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.401933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.402240] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.403197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7dc7ae46-ec5d-4930-abc1-caf23c0f66ac with status ACTIVE [ 1019.403446] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.403580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.403656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.403885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.403978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.404244] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.404330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.404480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.404681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.404792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.405042] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.405194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.405266] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.405454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.405968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.405968] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7dc7ae46-ec5d-4930-abc1-caf23c0f66ac is going to be updated. [ 1019.419223] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eebcf594-4c7c-47d0-be40-4978b776cc9f [ 1019.419454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.419583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.419651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.419862] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.419955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.420063] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eebcf594-4c7c-47d0-be40-4978b776cc9f already deleted. [ 1019.420150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eebcf594-4c7c-47d0-be40-4978b776cc9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.426172] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.426370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.426370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.426621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.426808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.426967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dc7ae46-ec5d-4930-abc1-caf23c0f66ac" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.566580] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.566799] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.566931] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.567251] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.567541] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.567710] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.568050] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.568271] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.568529] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.568825] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.569016] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.569205] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.569374] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.569580] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.569890] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.570167] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.591361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.591568] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.591722] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.591911] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.592346] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.592583] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.594741] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.594741] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.594741] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43f02a3-faf6-4597-8a81-6c4acdc3d54c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.603158] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.603158] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.603158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df already deleted. [ 1019.603158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.615803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1019.616018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.616207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.616441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.616633] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.616920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.616920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.617040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.617040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.617171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.617546] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.691235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57828e0d-c3cb-4556-9802-017ac3330eda: rpc.has_security_group_logging(os_id): False [ 1019.709262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.709262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.709262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.709262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.709821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.710028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.710207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.710351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.711564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.711564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.711564] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda is going to be created. [ 1019.776432] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.776793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1019.780027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.780027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1019.780027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1019.789169] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: IN_PROGRESS for 2s [ 1019.908021] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.096596] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.096871] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.096968] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.097481] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.097606] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.097665] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port f43f02a3-faf6-4597-8a81-6c4acdc3d54c not found, creating... [ 1020.097951] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.098156] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.098285] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.098539] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.098680] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.099012] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.099352] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.099482] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.099702] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.099879] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.100090] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: f43f02a3-faf6-4597-8a81-6c4acdc3d54c is going to be created. [ 1020.119628] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.119820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.119894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.120115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.120271] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.120381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.120450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.120607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.120690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.120779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.121221] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.121342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.121406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.121558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.121754] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.121855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.121918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.122100] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.122182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.122272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.122353] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.124731] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.124912] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.125051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.125287] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.125504] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.125722] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.410889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.410889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.410889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.411126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.411175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.411297] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 is going to be created. [ 1020.433603] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.433857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.433857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.434270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.434270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.443375] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 in Status: UNINITIALIZED for 2s [ 1020.552739] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1020.552957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.553177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.553410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.553606] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.553718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.553785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.553938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.554035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.554126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.554289] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.554375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.554438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.554591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.554718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.554812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.554873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.555015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.555096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.555179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.555265] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.624843] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 1020.642160] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.642327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.642436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.642710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.642801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.643025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.643293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.643293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.643395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.643498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.643738] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.643847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.643910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.644099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.644204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.644430] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.644521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.644593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.644759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.644854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.644944] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1020.715782] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.716068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.716068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.717113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.717113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.741302] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1020.978604] env[62815]: INFO networking_nsxv3.common.synchronization [req-249ce67b-6d51-4880-8043-b29dc6c8ac12 req-210aa8c3-1b9e-45dc-b8d1-ea2ae297bac1 service nova] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_rules [ 1020.978685] env[62815]: INFO networking_nsxv3.common.synchronization [req-249ce67b-6d51-4880-8043-b29dc6c8ac12 req-210aa8c3-1b9e-45dc-b8d1-ea2ae297bac1 service nova] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_members [ 1020.978806] env[62815]: INFO networking_nsxv3.common.synchronization [req-249ce67b-6d51-4880-8043-b29dc6c8ac12 req-210aa8c3-1b9e-45dc-b8d1-ea2ae297bac1 service nova] Enqueued Resource ID: f43f02a3-faf6-4597-8a81-6c4acdc3d54c with Priority: HIGHEST for action port [ 1020.979061] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_rules [ 1020.979295] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_members [ 1020.979295] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43f02a3-faf6-4597-8a81-6c4acdc3d54c with Priority: HIGHEST for action port [ 1020.979879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.980055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.980095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.980282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.980366] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.981841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.981841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.981841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.981841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.982035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.982096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.982170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.982331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.982424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1020.982510] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.983381] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.983498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.983561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.983812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.983812] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43f02a3-faf6-4597-8a81-6c4acdc3d54c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.996277] env[62815]: INFO networking_nsxv3.common.synchronization [None req-26be7107-4436-4b3a-a5f4-3ee06f0b917d tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_rules [ 1020.996776] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_rules [ 1020.997108] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.997234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1020.997299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.997568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1020.997642] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.060284] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d50f35ff-72d3-4ef9-9449-f84f0a4d4e25: rpc.has_security_group_logging(os_id): False [ 1021.079499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.079499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.079499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.079499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.079989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.079989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.079989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.079989] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.079989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.083415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.083588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.083764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.083804] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1021.122788] env[62815]: INFO networking_nsxv3.common.synchronization [None req-bba774d7-adc9-4851-ba0b-3a3c106bcb89 tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_rules [ 1021.123438] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_rules [ 1021.123809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.123909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.146440] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.146585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.146661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.146956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.147027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.161951] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1021.250034] env[62815]: INFO networking_nsxv3.common.synchronization [req-d1bf7aea-bd66-4c6f-8bb1-fc98445b9f93 req-502876bc-aec4-4b00-9c95-a9db42559e15 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1021.250596] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1021.250915] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.251055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.251126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.251327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.251481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.251580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.251642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.251786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.251873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.253064] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.488724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.488724] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.488724] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f43f02a3-faf6-4597-8a81-6c4acdc3d54c with status ACTIVE [ 1021.488724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.488724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.488724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.491908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.492238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.492651] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.495471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.495471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.495471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.495471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.495471] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f43f02a3-faf6-4597-8a81-6c4acdc3d54c is going to be updated. [ 1021.518128] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.518517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.519504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.519504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.519742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.520107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f43f02a3-faf6-4597-8a81-6c4acdc3d54c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.521613] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.523893] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa already deleted. [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.523893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.523893] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.758156] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.800828] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: SUCCESS [ 1021.801271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.806826] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.807622] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.811017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.811017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.811017] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.811017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.811017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.811017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.811017] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.811017] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.811017] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.811017] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.811017] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.811608] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.811608] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.811608] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.832819] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.833010] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.833226] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.833442] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1021.833816] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-3a3f284c-0829-433d-abb9-eafa700f8b69 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.834123] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1021.834325] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.834853] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1021.835053] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3f284c-0829-433d-abb9-eafa700f8b69',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.997912] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.043516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.043624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.043624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.043948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.043948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.044070] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa already deleted. [ 1022.044107] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.262313] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.337898] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.339075] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.339075] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.339075] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.339075] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.339075] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 3a3f284c-0829-433d-abb9-eafa700f8b69 not found, creating... [ 1022.339933] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.339933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.339933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.339933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.340139] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.340453] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.340614] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.340734] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.340946] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.341095] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.341320] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 3a3f284c-0829-433d-abb9-eafa700f8b69 is going to be created. [ 1022.361934] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.362257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.362703] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.362703] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.363014] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.363149] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.459483] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 in Status: SUCCESS [ 1022.459667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.459842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.460114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.460310] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.460427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.460493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.461027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.461027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.461027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.461027] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.503585] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.503769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.503857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.504088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.504203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.504308] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df is going to be created. [ 1022.530702] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.530927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.530927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.531280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.531537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.542036] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df in Status: UNINITIALIZED for 2s [ 1022.768450] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.768750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.768750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.768902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.768994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.769120] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be updated. [ 1022.771312] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1022.771466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.817269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.817411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1022.817482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.817699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1022.817839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1022.828136] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 1022.963753] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.176884] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1023.177271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.177485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.177759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.177855] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.240921] env[62815]: INFO networking_nsxv3.common.synchronization [req-d1bf7aea-bd66-4c6f-8bb1-fc98445b9f93 req-3b84b22b-3cc5-496d-bfc7-b692b721f637 service nova] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 1023.241216] env[62815]: INFO networking_nsxv3.common.synchronization [req-d1bf7aea-bd66-4c6f-8bb1-fc98445b9f93 req-3b84b22b-3cc5-496d-bfc7-b692b721f637 service nova] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1023.241216] env[62815]: INFO networking_nsxv3.common.synchronization [req-d1bf7aea-bd66-4c6f-8bb1-fc98445b9f93 req-3b84b22b-3cc5-496d-bfc7-b692b721f637 service nova] Enqueued Resource ID: 3a3f284c-0829-433d-abb9-eafa700f8b69 with Priority: HIGHEST for action port [ 1023.241919] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_rules [ 1023.241919] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1023.245197] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a3f284c-0829-433d-abb9-eafa700f8b69 with Priority: HIGHEST for action port [ 1023.245197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.245197] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.245197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.245197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a3f284c-0829-433d-abb9-eafa700f8b69 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.245197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.245197] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3f284c-0829-433d-abb9-eafa700f8b69',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.466614] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04: rpc.has_security_group_logging(os_id): False [ 1023.485027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.485227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.485304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.485514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.485599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.485840] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.485931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.485993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.486163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.486238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.486320] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 is going to be created. [ 1023.547347] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.547555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.547624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.547858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.548105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.560571] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 in Status: IN_PROGRESS for 2s [ 1023.681358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.681541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.681598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.681808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.681974] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.682113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.682206] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.682363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.682458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.682545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.682682] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.746742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.746920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.747170] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a3f284c-0829-433d-abb9-eafa700f8b69 with status ACTIVE [ 1023.747402] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.747529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.747620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.748287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.748287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.748287] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.748588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.748588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.748725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.748759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.749462] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.749462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.749462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.749462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.749462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.749462] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a3f284c-0829-433d-abb9-eafa700f8b69 is going to be updated. [ 1023.784541] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.784541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1023.784541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.784859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1023.784859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1023.784941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a3f284c-0829-433d-abb9-eafa700f8b69" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.185476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.185720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.185720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.186242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.186242] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.186397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.186397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.186571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.186662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.186759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.186957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.187088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.187157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.187328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.187502] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.187702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.187901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.187994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.188785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.188785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.188785] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.551140] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df in Status: SUCCESS [ 1024.551400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.552221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.552562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.552853] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.553061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.553175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.553810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.554019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.554245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.554313] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.691201] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d50f35ff-72d3-4ef9-9449-f84f0a4d4e25: rpc.has_security_group_logging(os_id): False [ 1024.714716] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.714716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.714716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.714716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.714716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.715339] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.715618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.715618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.715911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.716198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.716622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.716873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.716995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.717233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.717360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.717619] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.717772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.717927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.718131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.718335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.718395] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1024.800959] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.801356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.801356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.801569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.801795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.818084] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1024.838639] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 1024.838856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.839043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.839278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.839464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.839578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1024.839643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.839793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1024.839873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1024.839968] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.058200] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.137461] env[62815]: INFO networking_nsxv3.common.synchronization [req-810a9ea0-24e4-4af1-b9ee-c962e861d473 req-8bb004cc-1137-4f08-95b4-b38e55227846 tempest-ImagesTestJSON-58193299 tempest-ImagesTestJSON-58193299-project-member] Enqueued Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 1025.138367] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95315c29-36f4-4fb3-afae-f96b062c5650 with Priority: HIGHEST for action security_group_members [ 1025.138367] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-95315c29-36f4-4fb3-afae-f96b062c5650 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.138509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.138509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.138692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.138846] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.138945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.139020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.139395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.139490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.139585] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95315c29-36f4-4fb3-afae-f96b062c5650',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.345103] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.563763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da316b9b-b9bf-4447-82c9-6a5a9cd1d7df: rpc.has_security_group_logging(os_id): False [ 1025.579871] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 in Status: SUCCESS [ 1025.580208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.581659] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.581836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.581942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.582267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.582383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.582711] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.582851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.582952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.583185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.583302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.583422] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df is going to be created. [ 1025.644582] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.644582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.644582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.644582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.644582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.645243] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.645355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.645421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.645583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.645666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.645839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.645937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.645999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.646156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.646250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.646441] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 is going to be updated. [ 1025.658906] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df in Status: IN_PROGRESS for 2s [ 1025.705712] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.705712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1025.705712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.705712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1025.705712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1025.715109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: IN_PROGRESS for 2s [ 1025.848119] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.024758] env[62815]: INFO networking_nsxv3.common.synchronization [req-c4dac181-fe14-459d-a70a-45deba93ee7e req-de53f223-64cd-4b34-b3fd-e03bcc0d9b93 tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1026.025349] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1026.025678] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.025802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.025871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.027283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.027814] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.027814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.027932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.028227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.028433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.028597] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.351228] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.351392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.351458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.351688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.351781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.351883] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be updated. [ 1026.383945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.384122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.384259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.384488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.384633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.397090] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 1026.534266] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.543863] env[62815]: INFO networking_nsxv3.common.synchronization [req-1ec1c1e2-1ca6-4128-8828-88263056c8d2 req-ac0e9218-d9d9-46e7-83ee-8d6807e46345 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1026.544927] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1026.545483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.545483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.545483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.545658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.545817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.545967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.545967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.546128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.546216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.546309] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.715160] env[62815]: INFO networking_nsxv3.common.synchronization [req-c4dac181-fe14-459d-a70a-45deba93ee7e req-f0581001-0f0a-4418-9b0c-722805f1a0fe tempest-ServersTestMultiNic-1392553225 tempest-ServersTestMultiNic-1392553225-project-member] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1026.715894] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGHEST for action security_group_members [ 1026.716087] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.716252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.808806] env[62815]: INFO networking_nsxv3.common.synchronization [req-6a117685-f02d-41ab-bb76-93c0a9322fa1 req-f2035fb9-f880-4675-860e-dd14ed8fcf93 tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1026.809486] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1026.809939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.810642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.810770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.811090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.812035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.812035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1026.812035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.812035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1026.812035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1026.812035] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.835060] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1026.835377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.036613] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.048772] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.048967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.049056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.049237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.049623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.049770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.050247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.050354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.050528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.050670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.050726] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 1027.077964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.078115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.078184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.079475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.079475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.086918] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 1027.220557] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.220808] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.220992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.221298] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.221564] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.221757] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.221843] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.222081] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.222290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.222539] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.222697] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.222818] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.222933] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.223098] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.223194] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.223368] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.243217] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.243460] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.243551] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.243766] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.244174] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e897a404-c609-447d-9de6-84bd73d1ac63 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.244481] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.244608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.244973] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.245166] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e897a404-c609-447d-9de6-84bd73d1ac63',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.315836] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.316050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.316165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.316450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.316555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.316764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.316871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.316929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.317480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.317480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.317480] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1027.348109] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.348246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.348326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.348532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.348670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.356729] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1027.539726] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.539842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.539908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.540197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.540346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.540405] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1027.565329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.565465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.565545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.565746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.565885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.573975] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1027.673185] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df in Status: SUCCESS [ 1027.673524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.723976] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95315c29-36f4-4fb3-afae-f96b062c5650 in Status: SUCCESS [ 1027.724175] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95315c29-36f4-4fb3-afae-f96b062c5650 deletion is rescheduled due to dependency. [ 1027.724292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95315c29-36f4-4fb3-afae-f96b062c5650" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.747674] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.747879] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.748027] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.748324] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.748494] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.748646] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e897a404-c609-447d-9de6-84bd73d1ac63 not found, creating... [ 1027.748903] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.749085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.749286] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.749530] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.749675] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.749964] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.750142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.750266] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.750862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.750862] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.750975] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e897a404-c609-447d-9de6-84bd73d1ac63 is going to be created. [ 1027.813690] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.813926] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1027.814071] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.814493] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1027.814586] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1027.814820] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.127863] env[62815]: INFO networking_nsxv3.common.synchronization [req-418a1a24-f7f6-4de1-9e9f-13c6ab94f425 req-24369dad-84d2-499b-90e4-8f634ca24b18 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1028.128573] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1028.128969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.129117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.129231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.129461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.129631] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.129761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.129828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.130054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.130351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.130474] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.407054] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 1028.407302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.407833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.408074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.409563] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.409563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.409563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.409563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.409563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.409563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1028.409563] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.576368] env[62815]: INFO networking_nsxv3.common.synchronization [req-6a117685-f02d-41ab-bb76-93c0a9322fa1 req-76096c9f-4104-4ae8-acc3-1e4d36953a47 service nova] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_rules [ 1028.576562] env[62815]: INFO networking_nsxv3.common.synchronization [req-6a117685-f02d-41ab-bb76-93c0a9322fa1 req-76096c9f-4104-4ae8-acc3-1e4d36953a47 service nova] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1028.576708] env[62815]: INFO networking_nsxv3.common.synchronization [req-6a117685-f02d-41ab-bb76-93c0a9322fa1 req-76096c9f-4104-4ae8-acc3-1e4d36953a47 service nova] Enqueued Resource ID: e897a404-c609-447d-9de6-84bd73d1ac63 with Priority: HIGHEST for action port [ 1028.577231] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_rules [ 1028.577366] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1028.577458] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e897a404-c609-447d-9de6-84bd73d1ac63 with Priority: HIGHEST for action port [ 1028.577728] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.577847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.577902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.578237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.578319] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.579449] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.579549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.579742] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e897a404-c609-447d-9de6-84bd73d1ac63 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.579843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1028.580127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.580127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1028.580223] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e897a404-c609-447d-9de6-84bd73d1ac63',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.633233] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.911390] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.083479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.083479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.083479] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e897a404-c609-447d-9de6-84bd73d1ac63 with status ACTIVE [ 1029.083479] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.083479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.083479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.083479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.083758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.083758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.083829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.083829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.084366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.084366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.084366] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.084366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.084606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.084606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.084674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.084763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e897a404-c609-447d-9de6-84bd73d1ac63 is going to be updated. [ 1029.095660] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 1029.096053] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 1029.096053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.106152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.106312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.106378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.106619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.106705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.106875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e897a404-c609-447d-9de6-84bd73d1ac63" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.137748] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.369122] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1029.369122] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d deletion is rescheduled due to dependency. [ 1029.369605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.369605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.369605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.369927] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.369927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.369927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.370763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.370763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.370763] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.413585] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fcafbe4-f0ad-4f19-b02b-271988c9904b: rpc.has_security_group_logging(os_id): False [ 1029.431487] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.431632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.431705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.431914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.432012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.432307] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.432423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.432489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.432640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.432720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.432809] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be updated. [ 1029.495016] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.495167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.495224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.495430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.495591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.508652] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 1029.593832] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1029.594105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.594314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.594549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.594743] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.594858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.594923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.595096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.595179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.595277] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.639119] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.639119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.639119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.639119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.639119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.639119] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1029.669516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.669676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1029.669749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.669974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1029.674025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1029.687298] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1029.872625] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.100139] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.100270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.100389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.100865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.100865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.100973] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.101072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.101121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.101294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.101370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.101457] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be updated. [ 1030.128790] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.128790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.129031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.129145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.129299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.137235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: IN_PROGRESS for 2s [ 1030.380525] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.882634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.882810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.882870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.883113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.883232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.883345] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1030.918169] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.918533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1030.918533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.918656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1030.918872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1030.927968] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1031.531446] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 1031.531446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1031.699748] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1031.699748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.147526] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 in Status: SUCCESS [ 1032.147863] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 deletion is rescheduled due to dependency. [ 1032.148033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.936700] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1032.936985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.937115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.937354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.937565] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.937685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1032.937751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.937912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1032.937994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.938091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1032.938181] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.440967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.441150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.441225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.441441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.441608] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.441912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.441912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.441912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.442043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.442076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.442280] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.442378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.442438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.442580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.442719] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.442802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.442865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.442998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.443084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.443200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.443346] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.578343] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1033.578343] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1033.946591] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0748a1f-4ae2-44e2-8ece-647fc8e0c23d: rpc.has_security_group_logging(os_id): False [ 1033.965931] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.966104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.966207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.966474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.966684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.967065] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.967065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.967335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.967540] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.967710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.967988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.968235] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.968355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1033.968424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.968593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1033.968675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1033.968763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1034.026599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.026821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.026902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.027130] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.027287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.041267] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1034.103346] env[62815]: INFO networking_nsxv3.common.synchronization [req-209cf143-8a3b-4d18-a5fd-843b6824cd5d req-8e945917-6ed9-41f8-bb10-0295b9653bba tempest-ServerRescueTestJSON-307513274 tempest-ServerRescueTestJSON-307513274-project-member] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 1034.103891] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGHEST for action security_group_members [ 1034.104961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.105182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.105334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.105814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.106303] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.106515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.106590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.107009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.107109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.107292] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.140762] env[62815]: INFO networking_nsxv3.common.synchronization [req-286a4535-e31b-4f13-8156-e5a59bba3b18 req-8a999565-6378-48a0-8eba-0c549093aec5 tempest-ServerTagsTestJSON-2018986079 tempest-ServerTagsTestJSON-2018986079-project-member] Enqueued Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_members [ 1034.140762] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_members [ 1034.140762] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.140762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.140762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.141221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.141259] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.141352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.141412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.141582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.141667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.141760] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.487727] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.487945] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-601" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.488092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-601" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.488457] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-601" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.488734] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.488898] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.489105] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.489367] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.489529] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.489808] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.489941] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.490086] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.490207] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.490590] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.490590] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.490590] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.493613] env[62815]: INFO networking_nsxv3.common.synchronization [None req-dec86b01-6446-4553-a0b1-db02e0f08f4e tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1034.494418] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1034.494873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.494873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.494873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.495071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.495218] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.495311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.495375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.495518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.495603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.495776] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.509901] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.510308] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.510308] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.510501] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-601" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.510756] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-38e38e83-626f-435f-9210-b0edce46d78e taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.510939] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.511093] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.511472] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.511624] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e38e83-626f-435f-9210-b0edce46d78e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.612155] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.612382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.612455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.612673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.612765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.612964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.613073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.613136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.613313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.613395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.613483] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be updated. [ 1034.638887] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.639047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.639120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.639337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.639527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.645357] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.645481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.645552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.645738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.645825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.646012] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.646119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.646221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.646436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.646527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.646561] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 already deleted. [ 1034.646675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.647612] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: IN_PROGRESS for 2s [ 1034.997555] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.997928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.997928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.998061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.998142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.998551] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.998551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1034.998551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.998782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1034.998782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1034.998886] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1035.016206] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.016491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.016568] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.016825] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.016978] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.017158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 38e38e83-626f-435f-9210-b0edce46d78e not found, creating... [ 1035.017435] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.017611] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.017724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.017948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.018108] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.018399] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.018590] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.018682] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.018892] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.020076] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.020076] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 38e38e83-626f-435f-9210-b0edce46d78e is going to be created. [ 1035.025697] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.025875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.025875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.026105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.026188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.034401] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1035.044739] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.045105] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.045177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.045449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.045699] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.045941] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.722611] env[62815]: INFO networking_nsxv3.common.synchronization [req-286a4535-e31b-4f13-8156-e5a59bba3b18 req-cdda1503-591a-4e3f-9b48-b723b3c680df service nova] Enqueued Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_rules [ 1035.722814] env[62815]: INFO networking_nsxv3.common.synchronization [req-286a4535-e31b-4f13-8156-e5a59bba3b18 req-cdda1503-591a-4e3f-9b48-b723b3c680df service nova] Enqueued Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_members [ 1035.722967] env[62815]: INFO networking_nsxv3.common.synchronization [req-286a4535-e31b-4f13-8156-e5a59bba3b18 req-cdda1503-591a-4e3f-9b48-b723b3c680df service nova] Enqueued Resource ID: 38e38e83-626f-435f-9210-b0edce46d78e with Priority: HIGHEST for action port [ 1035.723215] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_rules [ 1035.723406] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_members [ 1035.723475] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e38e83-626f-435f-9210-b0edce46d78e with Priority: HIGHEST for action port [ 1035.724427] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.724575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.724650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.724928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.725183] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.725844] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.726838] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.726838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1035.726838] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.727468] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e38e83-626f-435f-9210-b0edce46d78e taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.727586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1035.727661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.727781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1035.727852] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e38e83-626f-435f-9210-b0edce46d78e',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.054486] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1036.054843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.229661] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.229755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.229924] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e38e83-626f-435f-9210-b0edce46d78e with status ACTIVE [ 1036.230166] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.230760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.230760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.230760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.230760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.231013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.231013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.231092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.231219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.231333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.231485] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.231597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.231632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.231757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.231831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.231913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e38e83-626f-435f-9210-b0edce46d78e is going to be updated. [ 1036.233055] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.253622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.254055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.254055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.254055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.254258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.254350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e38e83-626f-435f-9210-b0edce46d78e" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.478807] env[62815]: INFO networking_nsxv3.common.synchronization [req-4cebc2d7-98b2-49b8-a73a-56cdf48011f3 req-31110e95-f63a-4d04-ba2c-0a91a7612099 tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_members [ 1036.479506] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_members [ 1036.479921] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.483415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.483556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.484258] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.485535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.485615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.485794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.485888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.485984] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.657129] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 in Status: SUCCESS [ 1036.657312] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 deletion is rescheduled due to dependency. [ 1036.657499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.739023] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.985992] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.986497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.986497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.986662] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.986928] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.989404] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.989975] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.989975] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.990144] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.990395] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.990515] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.990628] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.990739] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.991047] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.991047] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.991147] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.992941] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.993075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.993126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.993428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.993428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.993539] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.993760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1036.993760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.993846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1036.994072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1036.994072] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa already deleted. [ 1036.994072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.011661] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.012670] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1037.012670] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.012670] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-335" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.012932] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-0692196a-f287-432d-86e4-9e8b3f450a35 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.013175] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.013342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.013758] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.013899] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0692196a-f287-432d-86e4-9e8b3f450a35',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.044067] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1037.044252] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 deletion is rescheduled due to dependency. [ 1037.044371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.241901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.242272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.242272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.242419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.242473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.242568] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 is going to be created. [ 1037.263615] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.263871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.263991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.264223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.264493] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.274877] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 in Status: UNINITIALIZED for 2s [ 1037.520652] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.520907] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.521064] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.521379] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.521540] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.521696] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 0692196a-f287-432d-86e4-9e8b3f450a35 not found, creating... [ 1037.521949] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.522130] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.522323] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.522552] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.522699] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.522985] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.523162] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.523305] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.523527] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.523669] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.523813] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 0692196a-f287-432d-86e4-9e8b3f450a35 is going to be created. [ 1037.543149] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.543357] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1037.543490] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.543748] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1037.543983] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1037.544212] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.248172] env[62815]: INFO networking_nsxv3.common.synchronization [req-4cebc2d7-98b2-49b8-a73a-56cdf48011f3 req-59f92079-e04a-4801-a3a5-4fc6eb5cf7b0 service nova] Enqueued Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_rules [ 1038.248426] env[62815]: INFO networking_nsxv3.common.synchronization [req-4cebc2d7-98b2-49b8-a73a-56cdf48011f3 req-59f92079-e04a-4801-a3a5-4fc6eb5cf7b0 service nova] Enqueued Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_members [ 1038.248522] env[62815]: INFO networking_nsxv3.common.synchronization [req-4cebc2d7-98b2-49b8-a73a-56cdf48011f3 req-59f92079-e04a-4801-a3a5-4fc6eb5cf7b0 service nova] Enqueued Resource ID: 0692196a-f287-432d-86e4-9e8b3f450a35 with Priority: HIGHEST for action port [ 1038.248763] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_rules [ 1038.248889] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_members [ 1038.248986] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0692196a-f287-432d-86e4-9e8b3f450a35 with Priority: HIGHEST for action port [ 1038.249569] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.249702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.249764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.249963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.250057] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.252364] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.252364] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.252364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.252364] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.253025] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-0692196a-f287-432d-86e4-9e8b3f450a35 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.253099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.256696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.256696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.256696] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0692196a-f287-432d-86e4-9e8b3f450a35',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.754826] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.755875] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.755996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.756408] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0692196a-f287-432d-86e4-9e8b3f450a35 with status ACTIVE [ 1038.756579] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.756696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.756747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.756948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.757455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.757455] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.757455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.757455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.757707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.757707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.757808] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.758991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.758991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.758991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.758991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.758991] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0692196a-f287-432d-86e4-9e8b3f450a35 is going to be updated. [ 1038.778880] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.779061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1038.779156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.779340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1038.779476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1038.780174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0692196a-f287-432d-86e4-9e8b3f450a35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.108918] env[62815]: INFO networking_nsxv3.common.synchronization [req-1bb45d33-f48f-4f15-8d37-d51ab951d8d8 req-97960572-4e10-44d5-82a7-36ae392e7582 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1039.109576] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1039.109967] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.110139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.110243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.110456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.110663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.110786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.110853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.111060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.111170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.111290] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.256830] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.285702] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 in Status: SUCCESS [ 1039.285928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.286102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.286331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.287106] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.287249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.287319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.287833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.288037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.288163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.288889] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.437848] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.438076] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.438211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.438495] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.438758] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.438922] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.439062] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.439289] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.439443] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.439658] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.439780] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.439896] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.440013] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.440168] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.440294] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.440436] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.457421] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.457542] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.457686] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.457860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-200" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.458158] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.458339] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.458492] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.458853] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.459009] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73b2ac66-8e79-4e58-b1ad-1a94daff55f8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.614929] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.618599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.618693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.618931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.619078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.619295] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.619405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.619470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.619635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.619704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.619803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 1039.649432] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.649432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.649432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.649432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.649432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.655913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 1039.758750] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.758951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.759606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.759606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.759606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.759606] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa is going to be created. [ 1039.784035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.784235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.784310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.784543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.784709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.791387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.791806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.791806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.791806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.791991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.792072] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.792123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.792314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.792411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.792563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.792729] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.792826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.792890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.793063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.793216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.793356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.793421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.793567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.793654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.793738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.793841] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.795367] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa in Status: UNINITIALIZED for 2s [ 1039.961391] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.961725] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.962101] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.962416] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.962657] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.962891] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 73b2ac66-8e79-4e58-b1ad-1a94daff55f8 not found, creating... [ 1039.963391] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.963542] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.963698] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.963982] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.964202] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.964589] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.964815] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.964960] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.965563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.965563] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.965652] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 73b2ac66-8e79-4e58-b1ad-1a94daff55f8 is going to be created. [ 1039.986975] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.987177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1039.987273] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.987720] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1039.988097] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1039.988471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.296067] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a2c2367-6874-44cf-8d41-422278b8bbc7: rpc.has_security_group_logging(os_id): False [ 1040.313196] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.313362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.313406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.313636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.313720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.313903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.314011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.314079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.314231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.314311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.314491] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.314586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.314646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.314785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.314859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.315061] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.315158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.315219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.315372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.315453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.315538] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 is going to be created. [ 1040.369166] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.369385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.369458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.369650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.369823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1040.381705] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 in Status: IN_PROGRESS for 2s [ 1040.691436] env[62815]: INFO networking_nsxv3.common.synchronization [req-1bb45d33-f48f-4f15-8d37-d51ab951d8d8 req-896bf200-613d-42e4-a062-4770a670c94f service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 1040.691436] env[62815]: INFO networking_nsxv3.common.synchronization [req-1bb45d33-f48f-4f15-8d37-d51ab951d8d8 req-896bf200-613d-42e4-a062-4770a670c94f service nova] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1040.691436] env[62815]: INFO networking_nsxv3.common.synchronization [req-1bb45d33-f48f-4f15-8d37-d51ab951d8d8 req-896bf200-613d-42e4-a062-4770a670c94f service nova] Enqueued Resource ID: 73b2ac66-8e79-4e58-b1ad-1a94daff55f8 with Priority: HIGHEST for action port [ 1040.691436] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_rules [ 1040.691436] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1040.691954] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73b2ac66-8e79-4e58-b1ad-1a94daff55f8 with Priority: HIGHEST for action port [ 1040.691954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.691954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.691954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.692350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.692350] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.693770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.693886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.694123] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.694249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1040.694390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.697075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1040.697075] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73b2ac66-8e79-4e58-b1ad-1a94daff55f8',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.197434] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.197616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.198773] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73b2ac66-8e79-4e58-b1ad-1a94daff55f8 with status ACTIVE [ 1041.198773] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.198773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.198773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.198773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.198773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.198773] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.199327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.199327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.199327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.199327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.200094] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.200094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.200094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.200094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.200094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.200094] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73b2ac66-8e79-4e58-b1ad-1a94daff55f8 is going to be updated. [ 1041.236269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.236478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.237025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.237025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.237157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.237417] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73b2ac66-8e79-4e58-b1ad-1a94daff55f8" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.429664] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.430187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.430187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.430187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.430335] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.666569] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 4s [ 1041.805294] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa in Status: SUCCESS [ 1041.805294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.805511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.805792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.806097] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.806284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1041.806400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.806657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1041.806799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.806949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1041.807113] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.934469] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.310578] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.394841] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 in Status: SUCCESS [ 1042.395171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.436868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.815135] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6596d0c-454d-48ce-b640-ed4a68bd5faa: rpc.has_security_group_logging(os_id): False [ 1042.845047] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.845187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.846166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.846476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.846582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.847462] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.847462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.847462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.847462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.847462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.847462] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa is going to be created. [ 1042.917559] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.918816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1042.918816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.918816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1042.918816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1042.932348] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa in Status: IN_PROGRESS for 2s [ 1042.939408] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1042.939520] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1043.694593] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 1043.694927] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 1043.694927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.695077] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.695298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.695484] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.695594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.695661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.695813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.695895] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.695987] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.782329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.782494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.782575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.782825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.796537] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1043.797393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.798230] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1043.834383] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.834541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.834612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.834838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.849497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.850356] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1043.850356] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1043.850568] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1043.890056] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.890056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.890056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.890056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.894312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.894599] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1043.971118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.971118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1043.971118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.973437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1043.974854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1043.978119] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1044.021554] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.021554] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.024458] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.025293] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.028018] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.028018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.028018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.028018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.028018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.028018] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.028018] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.028018] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.028018] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.028018] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.028018] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.028018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.054020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.054020] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.054020] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.054020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.054020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.054020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.054020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.054020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.054020] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22ecee52-3e1b-45f9-b76e-dcb1141e65ba',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.172226] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.172466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.172565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.172819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.173640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.173736] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:53. [ 1044.173811] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'17388f1d-f975-4b0c-9539-e72fee58d139', '9a360f68-c409-4d28-9396-e41a05128638', '19461cde-6801-4c12-a058-618f670ad0d7', 'd50f35ff-72d3-4ef9-9449-f84f0a4d4e25', 'c7acd52f-0ca6-446a-a4c8-68abd06e46eb', 'b7396d6d-5d17-4765-b37a-cf2ed49220a2', '6ba85b5f-4e58-41b0-b69c-fab3d71be927', '58508d1e-03b6-4a82-ae3e-6bb998ff0ae0', 'c3b25207-a990-4fd7-b877-b071ab01d2a7', '6d9dce03-d37e-4edb-85ab-d71157c4485b', '7122d614-52b1-4ea3-88d7-21b71b12c2e4', '57828e0d-c3cb-4556-9802-017ac3330eda', 'cd01ddbc-d1e1-4701-8791-8347e2ae4ba7', '1fcafbe4-f0ad-4f19-b02b-271988c9904b', '1d6bbb76-6d82-445e-a124-2538b600ecb4', 'b341d199-0570-4483-a66b-c412fafde85f', 'd0748a1f-4ae2-44e2-8ece-647fc8e0c23d', 'a1a1399f-aaa7-4450-b8eb-595b8dff6f2f', 'fff1e9e6-fc12-4fc6-91f0-37bb29ad92da', 'b036f05a-9535-4198-b6ab-eff3bdc28054', 'b8d730a4-9510-494a-a33d-86b82a27d766', 'a03c29c0-c680-419e-9d7c-4307d6fd5fd7', '660d9a55-7b14-45fd-8919-bb2ac822b971', '686574a8-1080-450a-a759-40ce406709a1', 'da316b9b-b9bf-4447-82c9-6a5a9cd1d7df', '97bb76de-5dc3-4e83-aabb-986627b27731', '0a2c2367-6874-44cf-8d41-422278b8bbc7', 'c35be23b-c5a4-4440-8ddb-1a5f961d3c7d', 'd4eb0fce-410c-49a9-858d-6d903b2d7c99', '7db29840-7ccf-49ac-af49-fd6b13cfbba7', '6c580d0c-d242-4267-94c1-b84435b0f93c', 'e2f3140d-d06d-40e7-9719-ba1446ff3270', 'faad13ba-ac02-4335-855b-47b1737205ca', '6021d487-9de7-424f-8bb7-283b2180f7a7', '71609a59-7de6-462b-b6e5-244b95f4175c', '11303673-d09a-48d1-9cad-14317bc7650c', '50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04', 'df11bad1-7d19-47ba-9b6a-8f12d59d5612', '21b0e5c1-1fe6-480e-963c-67f29a11cd78', '64b65322-480c-4891-a478-1d5f60cffcc2', 'e6596d0c-454d-48ce-b640-ed4a68bd5faa', '6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d', '0a93e2c7-70fc-4898-bef6-476829a0870e', '0f996b59-23a9-402b-8f9c-3e070b4b44dd', '000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7', 'e2840bf9-b592-4644-bcf1-bd4ca72a79e5', '3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd', 'b4d6d0cd-3c56-42cd-8d37-8158526e935b', 'efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a', '50851b2f-e9ba-4c66-9351-f1d66386b1c2', 'bdd0df41-58d9-475d-b389-1f971293a516', '4881bfba-b46e-4d29-a2f7-9a11e08570b3', '95315c29-36f4-4fb3-afae-f96b062c5650'} {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1044.173938] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1044.193314] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.193314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.193612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.193612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.193794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.193794] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1044.193887] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1044.193949] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1044.198388] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.270976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.271135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.271204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.271449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.272512] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.273173] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1044.273173] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1044.273173] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1044.273173] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1044.273173] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/53 resources of Type:Security Group Rules [ 1044.273173] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGH for action security_group_rules [ 1044.273448] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGH for action security_group_rules [ 1044.273448] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGH for action security_group_rules [ 1044.273448] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGH for action security_group_rules [ 1044.273448] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGH for action security_group_rules [ 1044.273572] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGH for action security_group_rules [ 1044.273689] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGH for action security_group_rules [ 1044.273689] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGH for action security_group_rules [ 1044.273768] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGH for action security_group_rules [ 1044.273813] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGH for action security_group_rules [ 1044.273887] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGH for action security_group_rules [ 1044.274260] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGH for action security_group_rules [ 1044.274260] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGH for action security_group_rules [ 1044.274260] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGH for action security_group_rules [ 1044.274260] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGH for action security_group_rules [ 1044.274260] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGH for action security_group_rules [ 1044.274437] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGH for action security_group_rules [ 1044.274437] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGH for action security_group_rules [ 1044.274437] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGH for action security_group_rules [ 1044.274524] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGH for action security_group_rules [ 1044.274571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.557529] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.557671] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.557759] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.558078] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.558254] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.558419] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 22ecee52-3e1b-45f9-b76e-dcb1141e65ba not found, creating... [ 1044.558709] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.558889] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.559034] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.559284] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.559737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.559737] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.559923] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.560059] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.560661] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.561492] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.561492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba is going to be created. [ 1044.582723] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.582989] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1044.583119] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.583436] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1044.583701] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.583944] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1044.700077] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.946872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa in Status: SUCCESS [ 1044.947485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.204419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.204419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.204419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.204419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.204419] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.204419] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 1045.229650] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.231724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.231724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.231724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.231724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.238183] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [req-e03f1e01-dfe4-4082-8d0d-604811b50f12 req-bf017a2d-7993-4e10-b97c-bcf6beebaec0 service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [req-e03f1e01-dfe4-4082-8d0d-604811b50f12 req-bf017a2d-7993-4e10-b97c-bcf6beebaec0 service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [req-e03f1e01-dfe4-4082-8d0d-604811b50f12 req-bf017a2d-7993-4e10-b97c-bcf6beebaec0 service nova] Enqueued Resource ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba with Priority: HIGHEST for action port [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba with Priority: HIGHEST for action port [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17388f1d-f975-4b0c-9539-e72fee58d139 with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19461cde-6801-4c12-a058-618f670ad0d7 with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b036f05a-9535-4198-b6ab-eff3bdc28054 with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f with Priority: HIGH for action security_group_rules [ 1045.616243] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGH for action security_group_rules [ 1045.617879] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGH for action security_group_rules [ 1045.617994] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b341d199-0570-4483-a66b-c412fafde85f with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a360f68-c409-4d28-9396-e41a05128638 with Priority: HIGH for action security_group_rules [ 1045.621821] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 with Priority: HIGH for action security_group_rules [ 1045.622141] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.622249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.622249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.622544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.622600] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.625476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.625476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.625476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.625476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.625476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.625792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.625792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.625878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.625923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.626026] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.629036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.630593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.630716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.630905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.630990] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22ecee52-3e1b-45f9-b76e-dcb1141e65ba',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.632722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17388f1d-f975-4b0c-9539-e72fee58d139 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.632880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.632983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.633322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.633457] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17388f1d-f975-4b0c-9539-e72fee58d139',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.634509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19461cde-6801-4c12-a058-618f670ad0d7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.634669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.634769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.634991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.637807] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19461cde-6801-4c12-a058-618f670ad0d7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.638156] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.638298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.638395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.638576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.638676] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ba85b5f-4e58-41b0-b69c-fab3d71be927',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.639548] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.640586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.640586] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b036f05a-9535-4198-b6ab-eff3bdc28054 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.640826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.640826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.641425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.641538] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b036f05a-9535-4198-b6ab-eff3bdc28054',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a1399f-aaa7-4450-b8eb-595b8dff6f2f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.645868] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.645868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.646549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.646549] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.647306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b341d199-0570-4483-a66b-c412fafde85f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.647470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.647578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.647770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.647874] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b341d199-0570-4483-a66b-c412fafde85f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.648589] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.648734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.648828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.649020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.649088] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.652681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.652681] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.652681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.652681] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7122d614-52b1-4ea3-88d7-21b71b12c2e4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.652681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d9dce03-d37e-4edb-85ab-d71157c4485b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.652681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.653160] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d9dce03-d37e-4edb-85ab-d71157c4485b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.655794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3b25207-a990-4fd7-b877-b071ab01d2a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.655794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.655794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.655794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.655794] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3b25207-a990-4fd7-b877-b071ab01d2a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.655794] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.655794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.655794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.655794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.655794] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7396d6d-5d17-4765-b37a-cf2ed49220a2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.657648] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.657924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.658010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.659914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.660028] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58508d1e-03b6-4a82-ae3e-6bb998ff0ae0',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.661087] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.661087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.661087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.661284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.661284] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.662559] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a360f68-c409-4d28-9396-e41a05128638 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.662559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.662559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.662559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.662559] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a360f68-c409-4d28-9396-e41a05128638',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.662811] env[62815]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1045.664280] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.664963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.664963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.664963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.664963] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d50f35ff-72d3-4ef9-9449-f84f0a4d4e25',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.688089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.688243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.688314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.688521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.706544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.706959] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ba85b5f-4e58-41b0-b69c-fab3d71be927 is going to be deleted. [ 1045.766144] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.766858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1045.766858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.766858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1045.766858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1045.766858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ba85b5f-4e58-41b0-b69c-fab3d71be927" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.167189] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.170304] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.170304] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.170304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.170304] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.171494] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.171593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.172731] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.172731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.172731] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.173620] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.173706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.173778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.173921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.175037] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.175037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.175037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.175525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.175609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.175713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.175807] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.187387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.187513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.187585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.187797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.187959] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.188062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.188125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.188288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.188378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.188463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.188764] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.190374] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.190374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.190374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.190374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.190577] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.190627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.190702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.190827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.190963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.190994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.191953] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.193127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22ecee52-3e1b-45f9-b76e-dcb1141e65ba with status ACTIVE [ 1046.193324] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.194237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.194237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.194394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.194465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.194701] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.194809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.194875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.195380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.195380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.195380] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.195647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.195647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.196293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.196293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.196293] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba is going to be updated. [ 1046.197089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.197216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.197289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.197472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.197653] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.197759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.197825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.197992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.198092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.198199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.198374] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.199566] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.199674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.245418] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.245565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.245637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.245880] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.248078] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.248204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.249497] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.249583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.250432] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.250504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.261087] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.261195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.262471] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.262565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.263358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.263520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.264266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.264385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.265253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.265397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.276943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.277088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.279121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.279227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.286684] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1046.287511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.287511] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7122d614-52b1-4ea3-88d7-21b71b12c2e4 is going to be deleted. [ 1046.288537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.288537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.294504] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.294674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.294763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.295377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.295377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.295377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.296460] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.296575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.310875] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1046.311313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.311462] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17388f1d-f975-4b0c-9539-e72fee58d139 is going to be deleted. [ 1046.313168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.313286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.337408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.337599] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b036f05a-9535-4198-b6ab-eff3bdc28054 is going to be deleted. [ 1046.338736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.338840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.368872] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.369292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.369948] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.369948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.371855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.371955] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58508d1e-03b6-4a82-ae3e-6bb998ff0ae0 is going to be deleted. [ 1046.373307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.373307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.412240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.412539] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7396d6d-5d17-4765-b37a-cf2ed49220a2 is going to be deleted. [ 1046.413788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.414093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.415842] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.415979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.447340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.447535] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19461cde-6801-4c12-a058-618f670ad0d7 is going to be deleted. [ 1046.448574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.448819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.500310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.500550] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a1399f-aaa7-4450-b8eb-595b8dff6f2f is going to be deleted. [ 1046.501604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.501859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.503898] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.504049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.560813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.560959] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b341d199-0570-4483-a66b-c412fafde85f is going to be deleted. [ 1046.561885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.562122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.583238] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.583397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.607940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.608157] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d9dce03-d37e-4edb-85ab-d71157c4485b is going to be deleted. [ 1046.609017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.609971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.629210] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.629406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.640550] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.642029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.661063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.661204] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a360f68-c409-4d28-9396-e41a05128638 is going to be deleted. [ 1046.663193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.663471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.669520] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.672573] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.678622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.678754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.678754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.679203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.679203] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.679203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.679374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.679466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.679584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.679789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.680211] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.680276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.680346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.680499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.680646] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.681393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.681799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.681969] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.682360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.682747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.682908] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.689580] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.705740] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.706565] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.713852] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.719906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.721229] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3b25207-a990-4fd7-b877-b071ab01d2a7 is going to be deleted. [ 1046.722150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.722150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.766583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.766583] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d50f35ff-72d3-4ef9-9449-f84f0a4d4e25 is going to be deleted. [ 1046.767285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.768179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.768179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.768179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7122d614-52b1-4ea3-88d7-21b71b12c2e4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.768179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.768179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.768179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.768458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17388f1d-f975-4b0c-9539-e72fee58d139" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.769274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.769599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.769688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.769812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b036f05a-9535-4198-b6ab-eff3bdc28054" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.769950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.770324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.770324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.770427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58508d1e-03b6-4a82-ae3e-6bb998ff0ae0" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.770534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.770712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.770857] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.770974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7396d6d-5d17-4765-b37a-cf2ed49220a2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.771127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.771279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.771814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.771814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19461cde-6801-4c12-a058-618f670ad0d7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.772120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.772779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.772779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.772779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a1399f-aaa7-4450-b8eb-595b8dff6f2f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.782613] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.782694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.783465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.783465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.783465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.783465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d9dce03-d37e-4edb-85ab-d71157c4485b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.783975] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.784140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.784218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.784440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.784518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.784776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b341d199-0570-4483-a66b-c412fafde85f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.788880] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.789021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.789569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.789569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.789569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.789569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a360f68-c409-4d28-9396-e41a05128638" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.860317] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.860478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.860550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.860759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.860847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.860967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3b25207-a990-4fd7-b877-b071ab01d2a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.865365] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1046.865953] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.866113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1046.866187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.866420] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1046.866498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1046.866581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d50f35ff-72d3-4ef9-9449-f84f0a4d4e25" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.173034] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.173210] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.173369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.173601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.173695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.173795] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1047.175026] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fcafbe4-f0ad-4f19-b02b-271988c9904b: rpc.has_security_group_logging(os_id): False [ 1047.186365] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0748a1f-4ae2-44e2-8ece-647fc8e0c23d: rpc.has_security_group_logging(os_id): False [ 1047.191868] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57828e0d-c3cb-4556-9802-017ac3330eda: rpc.has_security_group_logging(os_id): False [ 1047.195858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.195858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.195858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.195858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.202626] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.202626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.202626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.203076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.203325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.206665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.206665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.206665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.206665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.211026] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7acd52f-0ca6-446a-a4c8-68abd06e46eb: rpc.has_security_group_logging(os_id): False [ 1047.211329] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd01ddbc-d1e1-4701-8791-8347e2ae4ba7: rpc.has_security_group_logging(os_id): False [ 1047.213245] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1047.214748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.214839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.217027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.217027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.217027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.217027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.217027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be updated. [ 1047.217027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.217027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.217596] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fff1e9e6-fc12-4fc6-91f0-37bb29ad92da: rpc.has_security_group_logging(os_id): False [ 1047.220574] env[62815]: INFO networking_nsxv3.common.synchronization [None req-422fa468-d966-4c2e-99ce-51b374ba0325 None None] Enqueued Resource ID: 05633bac-272f-408c-8646-56c992738b97 with Priority: HIGHEST for action port [ 1047.221974] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05633bac-272f-408c-8646-56c992738b97 with Priority: HIGHEST for action port [ 1047.222306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-05633bac-272f-408c-8646-56c992738b97 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.222425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05633bac-272f-408c-8646-56c992738b97" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.222491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05633bac-272f-408c-8646-56c992738b97" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.222779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05633bac-272f-408c-8646-56c992738b97" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.222822] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05633bac-272f-408c-8646-56c992738b97',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.232906] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.233177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.236040] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.236040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.236701] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.236701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.238133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.238424] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.238476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.238540] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.238808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.238808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.238887] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda is going to be updated. [ 1047.240215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.240404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.248688] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 1047.249439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.249439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.249542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.249638] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.249744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.249808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.249947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.250040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.250126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.250240] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.258617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.258875] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.260587] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.260587] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.260587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.260587] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1047.261927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.263176] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.282258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.282580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.282677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.282743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.282933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.283026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.283135] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da is going to be updated. [ 1047.286073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.286073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.299827] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.303152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.310545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.310878] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.310986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.311067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.311279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.311366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.311467] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb is going to be updated. [ 1047.313769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.313977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.317266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.317377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.327556] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.327708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.370646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.373254] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.373254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.373254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.373254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.373254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.373254] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1047.373254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.373254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.373667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.375033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.375203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.375374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.377171] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.377284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.377331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.377491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.377621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.378439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.378629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.378760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.424439] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: IN_PROGRESS for 2s [ 1047.425098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1047.430169] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: IN_PROGRESS for 2s [ 1047.431614] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 1047.461497] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.461644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.461698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.461912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.462071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.475885] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: IN_PROGRESS for 2s [ 1047.519573] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.519717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.519788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.520011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.520170] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.548904] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1047.726023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05633bac-272f-408c-8646-56c992738b97 [ 1047.726309] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.726418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.726490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.726723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.726817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.726913] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05633bac-272f-408c-8646-56c992738b97 already deleted. [ 1047.726993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05633bac-272f-408c-8646-56c992738b97" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.754710] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.754875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.755063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.755816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.755816] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.755816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.755816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.755816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.755816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.755816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.756104] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.756104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.756104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.756544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.756544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.756544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.756544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.756777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.756777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.756869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1047.756947] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.972207] env[62815]: INFO networking_nsxv3.common.synchronization [req-109daa49-dc1f-4e3a-9eb4-221e69e409f2 req-dcbcc685-eb25-4d5d-9ca5-abd433fcd445 tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: 5817c81b-90c5-403c-bf3d-6fbed0ba1daa with Priority: HIGHEST for action security_group_rules [ 1047.973571] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5817c81b-90c5-403c-bf3d-6fbed0ba1daa with Priority: HIGHEST for action security_group_rules [ 1047.974076] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5817c81b-90c5-403c-bf3d-6fbed0ba1daa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.974304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5817c81b-90c5-403c-bf3d-6fbed0ba1daa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1047.974439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5817c81b-90c5-403c-bf3d-6fbed0ba1daa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.974768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5817c81b-90c5-403c-bf3d-6fbed0ba1daa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1047.974909] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5817c81b-90c5-403c-bf3d-6fbed0ba1daa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.259828] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6021d487-9de7-424f-8bb7-283b2180f7a7: rpc.has_security_group_logging(os_id): False [ 1048.279473] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.279916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.280039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.280287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.300552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.300552] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.300552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.300552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.300928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.300928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.300928] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.301054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.301054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.304054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.304054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.304054] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.304054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.304054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.304054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.304054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.304054] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 1048.363930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.363930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.363930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.363930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.363930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.378835] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 1048.518252] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.518714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1048.518714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.518714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1048.518819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1048.518947] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5817c81b-90c5-403c-bf3d-6fbed0ba1daa already deleted. [ 1048.518947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5817c81b-90c5-403c-bf3d-6fbed0ba1daa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.213263] env[62815]: INFO networking_nsxv3.common.synchronization [req-cd909bf6-b712-4b0c-9174-fa8374ee9c1f req-315cf58d-bd8e-4cf8-bbf7-64ed8a733bed tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1049.213263] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1049.213263] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.213263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.213263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.214808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.215226] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.215487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.215636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.217959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.217959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.217959] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.228616] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.229809] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.229809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.230088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.230088] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.444218] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1049.444498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.445250] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: SUCCESS [ 1049.445432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.446063] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 1049.446247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.446817] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: SUCCESS [ 1049.446975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.486689] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: SUCCESS [ 1049.487451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.561594] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1049.561594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.653096] env[62815]: INFO networking_nsxv3.common.synchronization [None req-17fb12c3-e332-4cf2-b440-e79554e997a1 None None] Enqueued Resource ID: 55c483af-176f-4716-902c-64848ba2975f with Priority: HIGHEST for action port [ 1049.653096] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c483af-176f-4716-902c-64848ba2975f with Priority: HIGHEST for action port [ 1049.653096] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-55c483af-176f-4716-902c-64848ba2975f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.653096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55c483af-176f-4716-902c-64848ba2975f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.654251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55c483af-176f-4716-902c-64848ba2975f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.654746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55c483af-176f-4716-902c-64848ba2975f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.655115] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55c483af-176f-4716-902c-64848ba2975f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.722750] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.722904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.722984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.723204] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.723316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.723555] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.723660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.723722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.723874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.723951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.724081] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1049.732010] env[62815]: INFO networking_nsxv3.common.synchronization [req-df2aefcc-4196-4a6b-b1ff-e9223e5d6b7f req-56cc20dc-74c4-43cb-aff1-a3c577434f40 tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: d34de1ce-5538-47f1-a711-efc557830cbd with Priority: HIGHEST for action security_group_rules [ 1049.732309] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34de1ce-5538-47f1-a711-efc557830cbd with Priority: HIGHEST for action security_group_rules [ 1049.732865] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34de1ce-5538-47f1-a711-efc557830cbd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.732987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34de1ce-5538-47f1-a711-efc557830cbd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.733068] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34de1ce-5538-47f1-a711-efc557830cbd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.733337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34de1ce-5538-47f1-a711-efc557830cbd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.733427] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34de1ce-5538-47f1-a711-efc557830cbd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.734358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.734487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.734535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.734703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.734855] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.734947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.735016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.735435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.735435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.735435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.735630] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.735630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.735630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.735753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.735894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.735985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.736060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.736409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.736492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.736546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.736633] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.750282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.750282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1049.750282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.750282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1049.750282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1049.758028] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1050.157204] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55c483af-176f-4716-902c-64848ba2975f [ 1050.157447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.157580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.157651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.157867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.157979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.158128] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55c483af-176f-4716-902c-64848ba2975f already deleted. [ 1050.158233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55c483af-176f-4716-902c-64848ba2975f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.239419] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d6bbb76-6d82-445e-a124-2538b600ecb4: rpc.has_security_group_logging(os_id): False [ 1050.260029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.260029] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34de1ce-5538-47f1-a711-efc557830cbd already deleted. [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34de1ce-5538-47f1-a711-efc557830cbd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.260029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.260029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.278020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.278020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.278020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.278020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.278598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.279660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.280351] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1050.295559] env[62815]: INFO networking_nsxv3.common.synchronization [None req-50f7a0f5-f2cb-47cb-bc2f-5d3c18d56a31 None None] Enqueued Resource ID: 17d614b6-1a74-418a-bec7-e7c4f21fc6a3 with Priority: HIGHEST for action port [ 1050.296131] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17d614b6-1a74-418a-bec7-e7c4f21fc6a3 with Priority: HIGHEST for action port [ 1050.296472] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-17d614b6-1a74-418a-bec7-e7c4f21fc6a3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.296558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17d614b6-1a74-418a-bec7-e7c4f21fc6a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.296625] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17d614b6-1a74-418a-bec7-e7c4f21fc6a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.296884] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17d614b6-1a74-418a-bec7-e7c4f21fc6a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.296968] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17d614b6-1a74-418a-bec7-e7c4f21fc6a3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.337434] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.337627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.337696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.337853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.338006] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.357945] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1050.407907] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 1050.408166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.799380] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17d614b6-1a74-418a-bec7-e7c4f21fc6a3 [ 1050.800588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.800588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1050.800588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.800588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1050.800588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1050.800588] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17d614b6-1a74-418a-bec7-e7c4f21fc6a3 already deleted. [ 1050.800588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17d614b6-1a74-418a-bec7-e7c4f21fc6a3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1051.518590] env[62815]: INFO networking_nsxv3.common.synchronization [req-a7558b90-c76f-45da-b415-1dfd9b8e6083 req-f4af2d0b-6b60-4f8c-a2ed-5cbc5fea943f tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: cfe324bf-a244-4207-9553-52caccb1c880 with Priority: HIGHEST for action security_group_rules [ 1051.520650] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfe324bf-a244-4207-9553-52caccb1c880 with Priority: HIGHEST for action security_group_rules [ 1051.520650] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfe324bf-a244-4207-9553-52caccb1c880 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.520650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfe324bf-a244-4207-9553-52caccb1c880" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1051.520650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfe324bf-a244-4207-9553-52caccb1c880" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.520650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfe324bf-a244-4207-9553-52caccb1c880" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1051.520650] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfe324bf-a244-4207-9553-52caccb1c880',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.767262] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1051.767467] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d deletion is rescheduled due to dependency. [ 1051.767560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.041051] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.041363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.041477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.041827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.042051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.042265] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfe324bf-a244-4207-9553-52caccb1c880 already deleted. [ 1052.042546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfe324bf-a244-4207-9553-52caccb1c880" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.175194] env[62815]: INFO networking_nsxv3.common.synchronization [req-e10d41fc-a348-4eda-a1ad-f7ad252adcb4 req-c3eed554-c751-4cd3-84a4-0d62d83b682d tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1052.175194] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1052.176013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.176152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.176221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.176665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.176845] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.176954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.177025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.177311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.177311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.177418] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.284012] env[62815]: INFO networking_nsxv3.common.synchronization [req-9a9152d2-01b4-42b4-a364-98ad7cb75eec req-6138c41c-be0c-4610-8194-74891eff509d tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: ae418de9-61ba-4fe1-aac1-fbb424152717 with Priority: HIGHEST for action security_group_rules [ 1052.284582] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae418de9-61ba-4fe1-aac1-fbb424152717 with Priority: HIGHEST for action security_group_rules [ 1052.284889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae418de9-61ba-4fe1-aac1-fbb424152717 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.285398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae418de9-61ba-4fe1-aac1-fbb424152717" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.285710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae418de9-61ba-4fe1-aac1-fbb424152717" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.286777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae418de9-61ba-4fe1-aac1-fbb424152717" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.286777] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae418de9-61ba-4fe1-aac1-fbb424152717',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.372253] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1052.372549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.373104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.373321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.373413] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.641282] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.641282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.641795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.641795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.641910] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.646531] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.646744] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.648312] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.649594] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.649594] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.649594] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.649930] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.649930] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.649930] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.650110] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.650196] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.669529] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.669712] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.669864] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.670065] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-931" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.670392] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-1055f830-da59-405d-8b99-3b84d89ceb35 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.670626] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.671125] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.671165] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.671345] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1055f830-da59-405d-8b99-3b84d89ceb35',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.681693] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.808023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.808195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.808238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.808452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.808542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.808640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae418de9-61ba-4fe1-aac1-fbb424152717 already deleted. [ 1052.808723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae418de9-61ba-4fe1-aac1-fbb424152717" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.875806] env[62815]: INFO networking_nsxv3.common.synchronization [None req-8a3daa6d-e760-4ce2-81f5-f6513ef5458b None None] Enqueued Resource ID: b21973e1-d26f-4df1-a41a-00f3dcedb76c with Priority: HIGHEST for action port [ 1052.876665] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.876814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.876885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.878770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.879017] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.879304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.879304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.879489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.879610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.879855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1052.879855] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.884042] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b21973e1-d26f-4df1-a41a-00f3dcedb76c with Priority: HIGHEST for action port [ 1052.884042] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b21973e1-d26f-4df1-a41a-00f3dcedb76c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.884042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b21973e1-d26f-4df1-a41a-00f3dcedb76c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.884042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b21973e1-d26f-4df1-a41a-00f3dcedb76c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.884042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b21973e1-d26f-4df1-a41a-00f3dcedb76c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.884042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b21973e1-d26f-4df1-a41a-00f3dcedb76c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.895287] env[62815]: INFO networking_nsxv3.common.synchronization [req-39061847-e459-4408-9f79-b858287fe762 req-24d1a910-86ec-4874-88bb-d7008d004b30 tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d with Priority: HIGHEST for action security_group_rules [ 1052.895287] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d with Priority: HIGHEST for action security_group_rules [ 1052.895287] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c19d93-5c9a-4514-aab9-3a950d43d46d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.895287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1052.895287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.895287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1052.895287] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c19d93-5c9a-4514-aab9-3a950d43d46d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.027583] env[62815]: INFO networking_nsxv3.common.synchronization [req-e1aae377-dba6-4893-9dde-54c4b89eb184 req-deec5964-f0de-4579-93f0-653f7b8df483 tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d with Priority: HIGHEST for action security_group_rules [ 1053.027746] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d with Priority: HIGHEST for action security_group_rules [ 1053.028152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c19d93-5c9a-4514-aab9-3a950d43d46d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.028262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.176178] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.176428] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.176558] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.176859] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.176992] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.177164] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 1055f830-da59-405d-8b99-3b84d89ceb35 not found, creating... [ 1053.177427] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.177581] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.177698] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.177923] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.178172] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.179746] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.179746] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.179746] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.179746] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.183180] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.183491] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 1055f830-da59-405d-8b99-3b84d89ceb35 is going to be created. [ 1053.185120] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.188588] env[62815]: INFO networking_nsxv3.common.synchronization [req-e14523c6-4364-4ce8-bd8c-632295c6611e req-92d54098-f455-4233-a333-f554a1006b90 tempest-SecurityGroupRulesTestJSON-1686144304 tempest-SecurityGroupRulesTestJSON-1686144304-project-member] Enqueued Resource ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d with Priority: HIGHEST for action security_group_rules [ 1053.189090] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d with Priority: HIGHEST for action security_group_rules [ 1053.190144] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c19d93-5c9a-4514-aab9-3a950d43d46d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.190144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.203317] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.203566] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.203720] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.204234] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.204321] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.204552] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.384758] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.384758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.384758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.385055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.385329] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.385438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.385501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.386305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.386305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.386305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.386305] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.386305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.386305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.386549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.386549] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.386549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.386643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.387676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.387676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.387676] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.387676] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.388318] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b21973e1-d26f-4df1-a41a-00f3dcedb76c [ 1053.388496] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.388601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.388672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.388981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.389073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.389164] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b21973e1-d26f-4df1-a41a-00f3dcedb76c already deleted. [ 1053.389248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b21973e1-d26f-4df1-a41a-00f3dcedb76c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.418930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.419084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.419153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.419344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.419435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.419528] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d already deleted. [ 1053.419610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.419751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.419899] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.419981] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c19d93-5c9a-4514-aab9-3a950d43d46d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.689972] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.690338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.690338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.690338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.690443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.690532] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1053.716232] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.716811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.716811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.716811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.716811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.727831] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1053.893299] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d6bbb76-6d82-445e-a124-2538b600ecb4: rpc.has_security_group_logging(os_id): False [ 1053.911026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.911026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.911026] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.911026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.911786] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.911786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.911786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.911786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.911988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.912202] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1053.940694] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.940694] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d already deleted. [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.940694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.940694] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c19d93-5c9a-4514-aab9-3a950d43d46d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.970731] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.976016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1053.976016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.976016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1053.976016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1053.993147] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1054.295150] env[62815]: INFO networking_nsxv3.common.synchronization [req-e10d41fc-a348-4eda-a1ad-f7ad252adcb4 req-9ab8f9fd-de00-4700-81fe-51eca5561b04 service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 1054.295150] env[62815]: INFO networking_nsxv3.common.synchronization [req-e10d41fc-a348-4eda-a1ad-f7ad252adcb4 req-9ab8f9fd-de00-4700-81fe-51eca5561b04 service nova] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1054.295150] env[62815]: INFO networking_nsxv3.common.synchronization [req-e10d41fc-a348-4eda-a1ad-f7ad252adcb4 req-9ab8f9fd-de00-4700-81fe-51eca5561b04 service nova] Enqueued Resource ID: 1055f830-da59-405d-8b99-3b84d89ceb35 with Priority: HIGHEST for action port [ 1054.295150] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_rules [ 1054.295150] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1054.295150] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1055f830-da59-405d-8b99-3b84d89ceb35 with Priority: HIGHEST for action port [ 1054.296000] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.296274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.296432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.296721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.296900] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.297802] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.298016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.298313] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1055f830-da59-405d-8b99-3b84d89ceb35 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.298845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.299040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.299306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.299478] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1055f830-da59-405d-8b99-3b84d89ceb35',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.356242] env[62815]: INFO networking_nsxv3.common.synchronization [req-0fd3247b-960b-406c-a5b0-c470c1d49902 req-2816a0ee-29dd-4b0f-9081-0c7785db4f09 tempest-ServerTagsTestJSON-2018986079 tempest-ServerTagsTestJSON-2018986079-project-member] Enqueued Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_members [ 1054.356743] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGHEST for action security_group_members [ 1054.357061] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.357417] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.357487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.357696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.357857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.357967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.358214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.358214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.358415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.358415] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.461735] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.461903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.461973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.462244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.462362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.462478] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c19d93-5c9a-4514-aab9-3a950d43d46d already deleted. [ 1054.462564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c19d93-5c9a-4514-aab9-3a950d43d46d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.801545] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.801794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.801967] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1055f830-da59-405d-8b99-3b84d89ceb35 with status ACTIVE [ 1054.802145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.802270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.802361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.802631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.802738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.802962] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.803091] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.803184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.803396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.803507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.803738] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.803866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.803956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.804174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.804262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.804382] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1055f830-da59-405d-8b99-3b84d89ceb35 is going to be updated. [ 1054.824282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.824504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.824504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.824719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.824858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.825069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1055f830-da59-405d-8b99-3b84d89ceb35" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.862276] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.862520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.862594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.862859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.884599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.885071] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.885212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.885212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.885449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.885583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.886266] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 is going to be updated. [ 1054.918953] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.919128] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1054.919202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.919416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1054.919594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1054.933730] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 in Status: IN_PROGRESS for 2s [ 1055.737536] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1055.737748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.737910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.738148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.738333] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.738450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1055.738517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.738666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1055.738748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1055.738846] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.007710] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1056.007710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.160320] env[62815]: INFO networking_nsxv3.common.synchronization [req-8e8836e5-7487-4df0-ab94-101309de467f req-4297627b-f2ef-4984-a9af-f2d6daa68e94 tempest-ServerDiskConfigTestJSON-2131327107 tempest-ServerDiskConfigTestJSON-2131327107-project-member] Enqueued Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1056.161090] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 with Priority: HIGHEST for action security_group_members [ 1056.161422] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021d487-9de7-424f-8bb7-283b2180f7a7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.161546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.161610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.161810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.161964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.162308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.162438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.162669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.162799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.162935] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021d487-9de7-424f-8bb7-283b2180f7a7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.242587] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.664877] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.665038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.665126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.665337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.665440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.665637] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.665736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.665793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.665943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.666043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.666158] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 is going to be updated. [ 1056.695920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.697283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1056.698440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.699328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1056.699881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1056.712105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: IN_PROGRESS for 2s [ 1056.746768] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.945227] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 in Status: SUCCESS [ 1056.945653] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 deletion is rescheduled due to dependency. [ 1056.945903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.249763] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.249763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.250174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.250174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.250174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.250269] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1057.273963] env[62815]: INFO networking_nsxv3.common.synchronization [req-b98f6368-ed30-4b4d-9649-9d4616d1efcf req-85895d00-0085-43cd-8680-0a2df0810027 tempest-ServersTestFqdnHostnames-1151627545 tempest-ServersTestFqdnHostnames-1151627545-project-member] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_members [ 1057.274700] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGHEST for action security_group_members [ 1057.275136] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.275395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.275559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.275832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.276089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.276292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.276443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.277413] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.277553] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.277682] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.279214] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.279328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.279390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.279586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.279690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.291909] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1057.784551] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.784551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.784551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.784791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.807730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.807936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.808073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.808160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.809093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.809093] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.809093] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 is going to be updated. [ 1057.839584] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.839707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1057.839762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.843020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1057.843020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1057.849352] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 in Status: IN_PROGRESS for 2s [ 1058.722892] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 in Status: SUCCESS [ 1058.722892] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021d487-9de7-424f-8bb7-283b2180f7a7 deletion is rescheduled due to dependency. [ 1058.722892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021d487-9de7-424f-8bb7-283b2180f7a7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.301800] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1059.302055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.302191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.302489] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.302683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.302831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.302927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.303303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.303303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.303303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.303303] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.435727] env[62815]: INFO networking_nsxv3.common.synchronization [None req-b6c9a028-645e-40ca-833f-916a2d8780a0 None None] Enqueued Resource ID: f019b7b9-37ca-487f-86dc-8bf99e214334 with Priority: HIGHEST for action port [ 1059.436587] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f019b7b9-37ca-487f-86dc-8bf99e214334 with Priority: HIGHEST for action port [ 1059.437075] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f019b7b9-37ca-487f-86dc-8bf99e214334 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.437221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f019b7b9-37ca-487f-86dc-8bf99e214334" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.437408] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f019b7b9-37ca-487f-86dc-8bf99e214334" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.437725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f019b7b9-37ca-487f-86dc-8bf99e214334" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.437850] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f019b7b9-37ca-487f-86dc-8bf99e214334',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.805514] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.807954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.807954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.807954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.807954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.808993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.808993] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.808993] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.859111] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 in Status: SUCCESS [ 1059.859111] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 deletion is rescheduled due to dependency. [ 1059.859111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.939824] env[62815]: INFO networking_nsxv3.common.synchronization [req-8647bd21-66bd-4cb3-8096-f294b4f1adad req-22ea5469-fb43-4341-95c5-aab01be9cf8a tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1059.939824] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f019b7b9-37ca-487f-86dc-8bf99e214334 [ 1059.939972] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.940144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.940263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.940966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.940966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.940966] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f019b7b9-37ca-487f-86dc-8bf99e214334 already deleted. [ 1059.940966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f019b7b9-37ca-487f-86dc-8bf99e214334" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.942187] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1059.942187] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.942187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.942187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.942187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.942468] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.942525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1059.942560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.942719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1059.942809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1059.942910] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.311143] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0df41-58d9-475d-b389-1f971293a516: rpc.has_security_group_logging(os_id): False [ 1060.317027] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2a037d3f-f94d-47ca-b5fc-f7107858436a tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1060.317730] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1060.318643] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.318783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.318911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.320508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.320508] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.335957] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.336148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.336186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.336396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.355876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.356147] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.356894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.357052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.357507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.357645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.358085] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.358485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.358800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.359120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.359295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.359544] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.359682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.359774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.360188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.360329] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.360454] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1060.418148] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.418148] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.418148] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.418148] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.418148] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.418148] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.418522] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.418816] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.419020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.419354] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.419412] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.419523] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.419630] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.419752] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.419860] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.420010] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.421882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.422012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.423162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.423393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.423738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.443375] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1060.444234] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.444397] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.444542] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.444748] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.445078] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.445262] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.445388] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.445712] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.445857] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a418c50-3cfd-420f-ad35-7ea07ccaabfb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.447174] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.447174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.447174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.447174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.447174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.447718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.447718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.451023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.451023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.451023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.451023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c already deleted. [ 1060.451023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.481250] env[62815]: INFO networking_nsxv3.common.synchronization [None req-56cd0f1c-c42e-4305-ae58-1c72bd2892c6 tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1060.481633] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1060.483593] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.483593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.840948] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.841283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.841283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.841283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.841373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.841484] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 already deleted. [ 1060.841578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.841771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.841984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.842088] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.949547] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.951049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.951049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.951049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.951049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.951049] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 3a418c50-3cfd-420f-ad35-7ea07ccaabfb not found, creating... [ 1060.951049] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.951049] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.951604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.951604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.951604] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.951755] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.951922] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.953064] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.953351] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.953525] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.953760] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 3a418c50-3cfd-420f-ad35-7ea07ccaabfb is going to be created. [ 1060.972538] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.972538] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1060.972538] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.972748] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1060.973020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1060.973139] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.365459] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.365611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1061.365695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.365883] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1061.366407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1061.366407] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 already deleted. [ 1061.366407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.008371] env[62815]: INFO networking_nsxv3.common.synchronization [req-8647bd21-66bd-4cb3-8096-f294b4f1adad req-ce17e751-400e-417b-96c1-002e148eab2c service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1062.008371] env[62815]: INFO networking_nsxv3.common.synchronization [req-8647bd21-66bd-4cb3-8096-f294b4f1adad req-ce17e751-400e-417b-96c1-002e148eab2c service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1062.008371] env[62815]: INFO networking_nsxv3.common.synchronization [req-8647bd21-66bd-4cb3-8096-f294b4f1adad req-ce17e751-400e-417b-96c1-002e148eab2c service nova] Enqueued Resource ID: 3a418c50-3cfd-420f-ad35-7ea07ccaabfb with Priority: HIGHEST for action port [ 1062.008371] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1062.008371] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1062.008371] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a418c50-3cfd-420f-ad35-7ea07ccaabfb with Priority: HIGHEST for action port [ 1062.008371] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.008371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.008371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.009257] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.009577] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.010540] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.011863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.012031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.012279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.012715] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.013023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.013187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.013528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.013766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.013974] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.015033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.015282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.015449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.015696] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.015864] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a418c50-3cfd-420f-ad35-7ea07ccaabfb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.022124] env[62815]: INFO networking_nsxv3.common.synchronization [None req-35bce26f-e280-4041-8dba-b8a1deabbf70 None None] Enqueued Resource ID: ecdd8baa-2f2e-433d-950a-a2aba04afcc2 with Priority: HIGHEST for action port [ 1062.024670] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdd8baa-2f2e-433d-950a-a2aba04afcc2 with Priority: HIGHEST for action port [ 1062.024670] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecdd8baa-2f2e-433d-950a-a2aba04afcc2 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.024670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecdd8baa-2f2e-433d-950a-a2aba04afcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.024670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecdd8baa-2f2e-433d-950a-a2aba04afcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.024670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecdd8baa-2f2e-433d-950a-a2aba04afcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.024670] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecdd8baa-2f2e-433d-950a-a2aba04afcc2',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.458542] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1062.458780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.518288] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.518426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.521770] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.523077] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a418c50-3cfd-420f-ad35-7ea07ccaabfb with status ACTIVE [ 1062.527238] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.527361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.527448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.527667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.527753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.527934] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.528039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.528098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.528246] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.528317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.528496] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.528580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.528637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.528768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.528837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.528916] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a418c50-3cfd-420f-ad35-7ea07ccaabfb is going to be updated. [ 1062.531763] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecdd8baa-2f2e-433d-950a-a2aba04afcc2 [ 1062.531916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.532028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.532092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.532238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.532313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.532410] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecdd8baa-2f2e-433d-950a-a2aba04afcc2 already deleted. [ 1062.532491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecdd8baa-2f2e-433d-950a-a2aba04afcc2" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.553851] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.554014] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1062.554054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.554256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1062.554401] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1062.554551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a418c50-3cfd-420f-ad35-7ea07ccaabfb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.023505] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.426501] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-419 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.426708] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.426840] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.427127] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.427387] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.427544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.427662] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.427878] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.428750] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.428990] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.429110] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.429224] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.429338] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.429664] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.430533] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.430741] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.450626] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.450626] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.450626] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.450626] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.451042] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.451192] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.451330] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.451632] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.451786] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22ecee52-3e1b-45f9-b76e-dcb1141e65ba',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.526612] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.526612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.526612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.526840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.526932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.527049] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be created. [ 1063.550894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.550894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.550894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.550894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.550894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.559274] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: UNINITIALIZED for 2s [ 1063.963020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.963020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.963020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.963497] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.963497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.963497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.963497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.963497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.963938] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba is going to be updated. [ 1063.985470] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.986074] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1063.986360] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.986827] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1063.987156] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1063.987489] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.748805] env[62815]: INFO networking_nsxv3.common.synchronization [req-2f48a0d3-48d9-48c7-8df1-a2065fab4f57 req-759f26ce-2997-4972-b144-5c665b6ef01a service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 1064.749102] env[62815]: INFO networking_nsxv3.common.synchronization [req-2f48a0d3-48d9-48c7-8df1-a2065fab4f57 req-759f26ce-2997-4972-b144-5c665b6ef01a service nova] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1064.749102] env[62815]: INFO networking_nsxv3.common.synchronization [req-2f48a0d3-48d9-48c7-8df1-a2065fab4f57 req-759f26ce-2997-4972-b144-5c665b6ef01a service nova] Enqueued Resource ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba with Priority: HIGHEST for action port [ 1064.750177] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_rules [ 1064.750177] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1064.750177] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba with Priority: HIGHEST for action port [ 1064.750177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.751150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.751258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.751478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.751566] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.752815] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.752815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.752815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.752945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.752995] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.753109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.753171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.753317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.753403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1064.753494] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.754265] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.754371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1064.754439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.754594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1064.754667] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22ecee52-3e1b-45f9-b76e-dcb1141e65ba',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.256496] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.256668] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.256874] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.257765] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22ecee52-3e1b-45f9-b76e-dcb1141e65ba with status ACTIVE [ 1065.257965] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.258366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.258366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.258366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.258494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.258601] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.258697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.258755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.258902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.258997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.259708] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.259708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.259708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.259708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.259708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.259708] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22ecee52-3e1b-45f9-b76e-dcb1141e65ba is going to be updated. [ 1065.279771] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.279897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.279994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.280151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.280297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.280471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22ecee52-3e1b-45f9-b76e-dcb1141e65ba" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.567512] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1065.567805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.568061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.568309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.568509] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.568647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1065.568732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.568843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1065.568952] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.569061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1065.569151] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.762204] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.071912] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.072046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.072103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.072320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.072548] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.072649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.072686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.072838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.072929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.073037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.073188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.073284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.073343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.073536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.073761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.073761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.073901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.073965] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.074120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.074234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.074290] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.264580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.264746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.264820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.265062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.265159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.265271] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1066.294393] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.294570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.294644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.294868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.295021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.308915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1066.390418] env[62815]: INFO networking_nsxv3.common.synchronization [req-bcbf9706-6306-42ff-95cf-ebc3a79e5cde req-97fe1847-191d-482c-bf9c-a886623f4427 tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1066.391077] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1066.391422] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.391545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.391611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.391819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.391969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.392126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.392126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.392276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.392362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.392583] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.581365] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933a2727-d7f2-415f-9a38-6d105996267c: rpc.has_security_group_logging(os_id): False [ 1066.601029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.601029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.601029] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.601029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.601598] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.601598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.601598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.601598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.601598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.601988] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be created. [ 1066.683583] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.683583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.683583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.683891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.683891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.696233] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-940 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.696432] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.696566] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.696889] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.697188] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.697377] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.697505] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.697734] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.697884] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.698109] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.698228] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.698344] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.698454] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.698595] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.698726] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.698864] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.700447] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1066.717752] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.717955] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.718125] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.718320] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-940" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.718659] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-eeda2afe-9812-4e82-8163-92aa1ad11852 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.718897] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.718993] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.720703] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.720703] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeda2afe-9812-4e82-8163-92aa1ad11852',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.894300] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.894584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.894584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.895050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.895217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.895454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.895608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.895706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.895989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.896122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.896239] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1066.922684] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.922864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1066.922910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.923156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1066.923352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1066.932316] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1067.223016] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.223368] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.223587] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.224048] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.224274] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.224462] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port eeda2afe-9812-4e82-8163-92aa1ad11852 not found, creating... [ 1067.224790] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.224965] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.225143] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.225685] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.225927] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.226284] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.226498] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.226657] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.226913] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.227118] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.227303] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: eeda2afe-9812-4e82-8163-92aa1ad11852 is going to be created. [ 1067.256477] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.256829] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1067.257018] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.257360] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1067.257611] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1067.257852] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.319508] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1068.320145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.320145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.320145] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.320314] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.320432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.320509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.320641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.320723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.320807] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.320896] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.384569] env[62815]: INFO networking_nsxv3.common.synchronization [req-bcbf9706-6306-42ff-95cf-ebc3a79e5cde req-8bd55bf1-ff91-43ef-8e14-8cb42cdd5095 service nova] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_rules [ 1068.384823] env[62815]: INFO networking_nsxv3.common.synchronization [req-bcbf9706-6306-42ff-95cf-ebc3a79e5cde req-8bd55bf1-ff91-43ef-8e14-8cb42cdd5095 service nova] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1068.384987] env[62815]: INFO networking_nsxv3.common.synchronization [req-bcbf9706-6306-42ff-95cf-ebc3a79e5cde req-8bd55bf1-ff91-43ef-8e14-8cb42cdd5095 service nova] Enqueued Resource ID: eeda2afe-9812-4e82-8163-92aa1ad11852 with Priority: HIGHEST for action port [ 1068.385496] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_rules [ 1068.385633] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1068.385732] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeda2afe-9812-4e82-8163-92aa1ad11852 with Priority: HIGHEST for action port [ 1068.386011] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.386135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.386201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.386389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.386472] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.387575] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.387685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.387872] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeda2afe-9812-4e82-8163-92aa1ad11852 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.387950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.388018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.388180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.388254] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeda2afe-9812-4e82-8163-92aa1ad11852',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.712721] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1068.713233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.823241] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.823430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.823598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.823741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.823911] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.824038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.824127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.824229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.824327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.824882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.824882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.824882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.825041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.825089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.825258] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.825340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.825396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.825586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.825586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.825937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.825937] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.895518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.895633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.895827] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeda2afe-9812-4e82-8163-92aa1ad11852 with status ACTIVE [ 1068.897930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.897930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.897930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.897930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.897930] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeda2afe-9812-4e82-8163-92aa1ad11852 is going to be updated. [ 1068.918172] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.918310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.918385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.918682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.918771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.918892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeda2afe-9812-4e82-8163-92aa1ad11852" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.942333] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1068.942333] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d deletion is rescheduled due to dependency. [ 1068.942805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.942805] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.943046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.943469] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.943661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1068.944719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.944719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1068.944719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1068.944719] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.332844] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d6bbb76-6d82-445e-a124-2538b600ecb4: rpc.has_security_group_logging(os_id): False [ 1069.348454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.351023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.351023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.351023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.353084] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.355514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.355514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.355514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.355514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.355514] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1069.420023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.420023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.420023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.420023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.420023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.433958] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1069.449688] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.590675] env[62815]: INFO networking_nsxv3.common.synchronization [req-4dcdcc12-5df6-4930-8cc1-e5b37ca5f19d req-60b535d4-6199-4aee-a525-5db1d20c856d tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1069.591257] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1069.591563] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.591679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.591745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.591946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.592108] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.592199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1069.592260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.592400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1069.592514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1069.592603] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.954415] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.094321] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.464689] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.464689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.464689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.464689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.464689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.464689] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1070.491849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.491849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.491849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.491849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.491849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.498212] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1070.598246] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.886211] env[62815]: INFO networking_nsxv3.common.synchronization [req-7c97b90f-f9bc-4073-b0cf-0f8219a18718 req-6f7e39bb-2494-4035-af40-b153c79286f0 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_members [ 1070.886698] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGHEST for action security_group_members [ 1070.887268] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.887415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.888184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.888184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.888184] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.888184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1070.888184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.888399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1070.888399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1070.888483] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.105153] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.105361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.105411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.105644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.105742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.105854] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1071.135040] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.135040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.135040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.135040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.135040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.142262] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1071.392893] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.392893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.392893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.392893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.412542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.412841] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.412982] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.413098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.413326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.413447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.413529] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df is going to be updated. [ 1071.437072] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.437249] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1071.437330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.437544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1071.437736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1071.444556] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df in Status: IN_PROGRESS for 2s [ 1071.451470] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1071.451739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.508415] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1072.508777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.508777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.509126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.509421] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.509619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.509738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.509996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.510163] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.510314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.510465] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.759228] env[62815]: INFO networking_nsxv3.common.synchronization [req-f6215580-b472-4fc1-85e8-d30e9f36f8bc req-32173085-8f64-4c17-b1d4-885aa4c86972 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1072.759815] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1072.760285] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.760285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.760470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.760505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.760657] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.760774] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1072.760818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.760953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1072.761312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1072.761430] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.012966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.013134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.013272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.013617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.013862] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.013995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.014088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.014271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.014365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.014479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.014672] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.014855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.014975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.015222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.015907] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.015907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.015907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.015907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.015907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.015907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.016133] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.153701] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1073.153914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.263984] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.264164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.264231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.264439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.264523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.264754] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.264852] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.264907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.265074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.265153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.265239] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1073.297447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.297583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.297633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.297828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.297983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.306210] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1073.453644] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df in Status: SUCCESS [ 1073.453890] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df deletion is rescheduled due to dependency. [ 1073.454023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.517992] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0748a1f-4ae2-44e2-8ece-647fc8e0c23d: rpc.has_security_group_logging(os_id): False [ 1073.534440] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.534621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.534703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.535067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.535184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.535409] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.535515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.535583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.535760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.535839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.536039] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.536139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.536203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.536349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.536430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.536627] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.536724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.536786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.536927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.537009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.537105] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1073.596606] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.596759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.596815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.597029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.597181] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1073.611159] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1073.778032] env[62815]: INFO networking_nsxv3.common.synchronization [None req-5621f9ba-0d9f-46df-915f-87ee0e628dc9 None None] Enqueued Resource ID: 9c72a4f7-0360-4ad4-8258-863d3b079683 with Priority: HIGHEST for action port [ 1073.778577] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c72a4f7-0360-4ad4-8258-863d3b079683 with Priority: HIGHEST for action port [ 1073.779446] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c72a4f7-0360-4ad4-8258-863d3b079683 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.779446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c72a4f7-0360-4ad4-8258-863d3b079683" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1073.779446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c72a4f7-0360-4ad4-8258-863d3b079683" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.779446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c72a4f7-0360-4ad4-8258-863d3b079683" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1073.779446] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c72a4f7-0360-4ad4-8258-863d3b079683',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.284654] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c72a4f7-0360-4ad4-8258-863d3b079683 [ 1074.284906] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.285053] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.285125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.285349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.285439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.285569] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c72a4f7-0360-4ad4-8258-863d3b079683 already deleted. [ 1074.285673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c72a4f7-0360-4ad4-8258-863d3b079683" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.635604] env[62815]: INFO networking_nsxv3.common.synchronization [req-0d175e63-f631-4bd2-97a4-f06704686a9f req-2a15cc09-2469-41dd-80d0-5a7b6e1f702c tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1074.638937] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1074.638937] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.638937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.638937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.638937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.638937] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.639455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1074.639455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.639455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1074.639455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1074.639565] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.142353] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.142520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.142634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.142860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.142961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.143229] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.143357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.143422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.143638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.143834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.143834] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 already deleted. [ 1075.143971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.181434] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.181628] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.181756] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.182111] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.182386] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.182645] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.182772] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.182999] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.183851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.184314] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.184393] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.184469] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.184583] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.184697] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.184809] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.184941] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.206477] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.206657] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.206803] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.206986] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.207344] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e2e262ac-6977-43f6-9dc5-f7d7363a2023 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.207558] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.207711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.208089] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.208207] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e262ac-6977-43f6-9dc5-f7d7363a2023',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.316846] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1075.316956] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1075.317269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.628157] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1075.628511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.710684] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.711130] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.711130] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.711777] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.711996] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.712184] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e2e262ac-6977-43f6-9dc5-f7d7363a2023 not found, creating... [ 1075.712517] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.712695] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.712822] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.713073] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.713210] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.713524] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.713698] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.713870] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.714064] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.714209] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.714361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 is going to be created. [ 1075.735066] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.735245] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1075.735374] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.735633] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1075.735866] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1075.736101] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.109330] env[62815]: INFO networking_nsxv3.common.synchronization [None req-97328c92-870a-4082-ad5c-6397a7804227 None None] Enqueued Resource ID: 9d535870-4583-4818-bda8-d1019a67dafb with Priority: HIGHEST for action port [ 1076.109330] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d535870-4583-4818-bda8-d1019a67dafb with Priority: HIGHEST for action port [ 1076.109330] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d535870-4583-4818-bda8-d1019a67dafb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.109330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d535870-4583-4818-bda8-d1019a67dafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.110910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d535870-4583-4818-bda8-d1019a67dafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.111499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d535870-4583-4818-bda8-d1019a67dafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.111707] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d535870-4583-4818-bda8-d1019a67dafb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.614050] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d535870-4583-4818-bda8-d1019a67dafb [ 1076.614299] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.614436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.614508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.614729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.614844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.614950] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d535870-4583-4818-bda8-d1019a67dafb already deleted. [ 1076.615044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d535870-4583-4818-bda8-d1019a67dafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.969742] env[62815]: INFO networking_nsxv3.common.synchronization [req-0d175e63-f631-4bd2-97a4-f06704686a9f req-38132f7a-de42-4849-8929-65260248c241 service nova] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1076.970087] env[62815]: INFO networking_nsxv3.common.synchronization [req-0d175e63-f631-4bd2-97a4-f06704686a9f req-38132f7a-de42-4849-8929-65260248c241 service nova] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1076.970087] env[62815]: INFO networking_nsxv3.common.synchronization [req-0d175e63-f631-4bd2-97a4-f06704686a9f req-38132f7a-de42-4849-8929-65260248c241 service nova] Enqueued Resource ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 with Priority: HIGHEST for action port [ 1076.970662] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1076.970792] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1076.970889] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 with Priority: HIGHEST for action port [ 1076.971187] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.971309] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.971378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.971684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.971821] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.973049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.973232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.973232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.973406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.973589] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.973701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.973766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.973916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.974013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1076.974107] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.974862] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2e262ac-6977-43f6-9dc5-f7d7363a2023 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.974964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1076.975043] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.975201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1076.975274] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e262ac-6977-43f6-9dc5-f7d7363a2023',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.477317] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.478144] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.478273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.478422] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2e262ac-6977-43f6-9dc5-f7d7363a2023 with status ACTIVE [ 1077.478580] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.478685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.478751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.478954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.479055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.479217] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.479311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.479372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.479525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.479611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.480332] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.480332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.480332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.480332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.480332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.480332] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 is going to be updated. [ 1077.502440] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.502440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1077.502440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.502824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1077.503081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.503312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1077.983411] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.485966] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.486296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.486296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.486462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.486513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.486609] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 is going to be created. [ 1078.511995] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.511995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.511995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.512168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.512219] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.522410] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: UNINITIALIZED for 2s [ 1078.852358] env[62815]: INFO networking_nsxv3.common.synchronization [req-a8401c8e-0cce-4ce2-a47c-ece1dd1598a0 req-61c0c91b-2999-4d0b-bf29-3e41cf3e71c3 tempest-ImagesOneServerNegativeTestJSON-86759796 tempest-ImagesOneServerNegativeTestJSON-86759796-project-member] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1078.852358] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGHEST for action security_group_members [ 1078.852358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.852358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.852358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.852358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.852358] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.852358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1078.855622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.855948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1078.858651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1078.858651] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.228683] env[62815]: INFO networking_nsxv3.common.synchronization [req-9121939a-945b-400f-b4f9-1eb121db0823 req-0b0bfacd-30cd-4e54-81bb-7e0f2e05a422 tempest-ServersTestJSON-2018771358 tempest-ServersTestJSON-2018771358-project-member] Enqueued Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1079.228683] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0df41-58d9-475d-b389-1f971293a516 with Priority: HIGHEST for action security_group_members [ 1079.228683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0df41-58d9-475d-b389-1f971293a516 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.228683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.228683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.228683] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0df41-58d9-475d-b389-1f971293a516',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.360975] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.361191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.361191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.361409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.361754] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.361754] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.362031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.362031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.362031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.362184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.362184] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be updated. [ 1079.401442] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.401784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.401955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.402290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.402701] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.411549] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: IN_PROGRESS for 2s [ 1079.730996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.731180] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.731252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.731487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.731583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.731795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.731896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.731958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.732131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.732208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.732297] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 is going to be updated. [ 1079.766386] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.766538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1079.766538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.766740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1079.766881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1079.774640] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: IN_PROGRESS for 2s [ 1080.542379] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: SUCCESS [ 1080.542839] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.543036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.543310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.543588] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.543679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1080.543718] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.543865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1080.543949] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.544049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1080.544141] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.046722] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.421406] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d in Status: SUCCESS [ 1081.421583] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d deletion is rescheduled due to dependency. [ 1081.421707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.550368] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 850db9bd-9d54-4da0-9136-8492981ff313: rpc.has_security_group_logging(os_id): False [ 1081.568631] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.568769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.568850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.569111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.569229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.569405] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.569507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.569564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.569722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.569798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.569885] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 is going to be created. [ 1081.641011] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.641214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1081.641255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.641492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1081.641682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1081.653566] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: IN_PROGRESS for 2s [ 1081.787997] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0df41-58d9-475d-b389-1f971293a516 in Status: SUCCESS [ 1081.787997] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0df41-58d9-475d-b389-1f971293a516 deletion is rescheduled due to dependency. [ 1081.787997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0df41-58d9-475d-b389-1f971293a516" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.192355] env[62815]: INFO networking_nsxv3.common.synchronization [req-a59743a6-8f2e-453b-a6ba-926307e1e2dc req-8a14de17-e7f3-4107-93eb-82f37c293eb6 tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1082.193041] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1082.193300] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.193441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.193598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.193765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.193943] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.194065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1082.194137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.194320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1082.194447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1082.194554] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.696725] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.199422] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.664875] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: SUCCESS [ 1083.665187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.702031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.702379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.702379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.702600] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.702710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.702815] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be updated. [ 1083.731019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.731231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.731231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.731450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.731606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.739404] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 1083.822121] env[62815]: INFO networking_nsxv3.common.synchronization [req-f08f6fff-3012-4dbf-b996-7602336ff8b9 req-b6dee606-e562-4a9e-8822-835444077e46 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1083.822884] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1083.823267] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.823433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.823548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.823875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.824066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.824177] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1083.824240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.824400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1083.824636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1083.824744] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.123921] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.124172] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-889" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.124462] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-889" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.124651] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-889" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.124949] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.125142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.125267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.125499] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.125717] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.125875] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.125994] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.126122] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.126235] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.126348] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.126461] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.126599] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.143776] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.143977] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1084.144110] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.144297] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-889" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.144651] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-6b4dc61f-84fa-48be-837d-076b48b9b6fc taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.144881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.145025] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.145352] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.145497] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4dc61f-84fa-48be-837d-076b48b9b6fc',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.326384] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.326581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.326697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.326875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.326968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.327191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.327288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.327350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.327505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.327580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.327697] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 already deleted. [ 1084.327777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.647473] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.647730] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.647853] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.648170] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.648335] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.648500] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 6b4dc61f-84fa-48be-837d-076b48b9b6fc not found, creating... [ 1084.648775] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.648959] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.649115] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.649419] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.649597] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.649898] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.650079] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.650205] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.650425] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.650583] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.650744] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc is going to be created. [ 1084.670403] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.670746] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1084.670913] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.671206] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1084.671440] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1084.671665] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.492182] env[62815]: INFO networking_nsxv3.common.synchronization [req-f08f6fff-3012-4dbf-b996-7602336ff8b9 req-8adec979-7ebc-4873-95d9-bba2a72f5683 service nova] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_rules [ 1085.492182] env[62815]: INFO networking_nsxv3.common.synchronization [req-f08f6fff-3012-4dbf-b996-7602336ff8b9 req-8adec979-7ebc-4873-95d9-bba2a72f5683 service nova] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1085.492182] env[62815]: INFO networking_nsxv3.common.synchronization [req-f08f6fff-3012-4dbf-b996-7602336ff8b9 req-8adec979-7ebc-4873-95d9-bba2a72f5683 service nova] Enqueued Resource ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc with Priority: HIGHEST for action port [ 1085.492182] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_rules [ 1085.492182] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1085.492182] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc with Priority: HIGHEST for action port [ 1085.495253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.495253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.495253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.495253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.495253] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.495938] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.496200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.496352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.496611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.496939] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.498012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.498012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.498012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.498012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.498012] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.503945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4dc61f-84fa-48be-837d-076b48b9b6fc taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.503945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.503945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.503945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.503945] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4dc61f-84fa-48be-837d-076b48b9b6fc',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.732394] env[62815]: INFO networking_nsxv3.common.synchronization [req-b734a0c3-8189-4f46-b1cc-48a20c7a4788 req-2f63f81a-6b28-4282-aba0-f7c83109d9e7 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_members [ 1085.732394] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGHEST for action security_group_members [ 1085.732561] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.732626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.732661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.732927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.733145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.733277] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1085.733362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.733545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1085.733656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1085.733784] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.747793] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 1085.748010] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.004540] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.004680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.004929] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.005739] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b4dc61f-84fa-48be-837d-076b48b9b6fc with status ACTIVE [ 1086.005923] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.006784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.006784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.006941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.007250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.007432] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.007545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.007612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.007804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.007886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.011244] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.011360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.011429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.011588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.011669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.011759] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc is going to be updated. [ 1086.032411] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.032871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.032871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.032871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.033056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.033105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.237706] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.237918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.237918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.238207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.238315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.238526] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.238630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.238694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.238867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.238953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.239130] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da is going to be updated. [ 1086.263717] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.264034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1086.264034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.264199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1086.264338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1086.272648] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: IN_PROGRESS for 2s [ 1086.516869] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.018272] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.018503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.018581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.018806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.018936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.019034] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be created. [ 1087.040550] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.040709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1087.040760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.041027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1087.041240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1087.049134] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: UNINITIALIZED for 2s [ 1088.282559] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da in Status: SUCCESS [ 1088.282851] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da deletion is rescheduled due to dependency. [ 1088.282927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.058789] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1089.058789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.059076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.059126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.059317] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.059415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1089.059534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.059652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.059711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.059793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.059972] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.562312] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.562670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1089.562670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.562769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.562936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.563048] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1089.563111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.563263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.563353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.563451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.563629] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.563725] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1089.563786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.563929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.564077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.564169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1089.564229] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.564366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1089.564441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.564520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1089.564606] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.066682] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd95b1fd-fc85-4df7-9a92-a110a9bd60e5: rpc.has_security_group_logging(os_id): False [ 1090.088021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.088021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.088021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.088021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.088726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.089074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.089301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.089454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.089682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.089953] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.090177] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be created. [ 1090.144374] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.144555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1090.144624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.144850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1090.145131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1090.153500] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1090.734110] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1090.734110] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1091.079245] env[62815]: INFO networking_nsxv3.common.synchronization [req-4d0d717d-23ef-4221-9732-5f0fddc79260 req-0685d168-3bdb-4fa6-97db-5aad02f6a5fc tempest-VolumesAdminNegativeTest-1112954704 tempest-VolumesAdminNegativeTest-1112954704-project-member] Enqueued Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_members [ 1091.079959] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_members [ 1091.080074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.080563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.080563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.080757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.081073] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.081255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.081362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.081631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.081782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.081955] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.448352] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.448570] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.448704] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.450021] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.450021] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.450021] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.450021] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.450021] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.450303] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.450303] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.450418] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.450556] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.450677] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.450793] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.450901] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.451048] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.469211] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.469414] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.469533] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.469727] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.470479] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-6fb66480-86cf-42e4-9525-0dca27498295 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.470479] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.470479] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.470762] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.470918] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb66480-86cf-42e4-9525-0dca27498295',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.585060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.585308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.585418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.585702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.585830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.586095] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.586255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.586342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.586560] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.586657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.586784] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 798082d0-32b4-40be-bc6c-1997cce6f121 already deleted. [ 1091.586893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.973319] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.973669] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.973860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.974213] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.974420] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.974616] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 6fb66480-86cf-42e4-9525-0dca27498295 not found, creating... [ 1091.974932] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.975186] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.975338] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.975630] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.975814] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.976165] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.976376] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.976527] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.976772] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.976923] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.977117] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 6fb66480-86cf-42e4-9525-0dca27498295 is going to be created. [ 1091.996819] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.997167] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1091.997384] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.997750] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1091.998114] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1091.998417] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1092.168012] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1092.168306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.133367] env[62815]: INFO networking_nsxv3.common.synchronization [req-4d0d717d-23ef-4221-9732-5f0fddc79260 req-ab99945a-0523-4bf3-b121-f170c4ae40d1 service nova] Enqueued Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_rules [ 1093.133726] env[62815]: INFO networking_nsxv3.common.synchronization [req-4d0d717d-23ef-4221-9732-5f0fddc79260 req-ab99945a-0523-4bf3-b121-f170c4ae40d1 service nova] Enqueued Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_members [ 1093.133791] env[62815]: INFO networking_nsxv3.common.synchronization [req-4d0d717d-23ef-4221-9732-5f0fddc79260 req-ab99945a-0523-4bf3-b121-f170c4ae40d1 service nova] Enqueued Resource ID: 6fb66480-86cf-42e4-9525-0dca27498295 with Priority: HIGHEST for action port [ 1093.134304] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_rules [ 1093.134450] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_members [ 1093.134611] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb66480-86cf-42e4-9525-0dca27498295 with Priority: HIGHEST for action port [ 1093.135028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.135606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.135606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.135770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.135896] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.137134] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.137295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.137385] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.137646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.137882] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.138089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.138193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.138440] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.138685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.138757] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.140266] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb66480-86cf-42e4-9525-0dca27498295 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.140414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.140490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.140925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.140925] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb66480-86cf-42e4-9525-0dca27498295',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.641272] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.642399] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.642550] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.642757] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fb66480-86cf-42e4-9525-0dca27498295 with status ACTIVE [ 1093.642924] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.643041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.643109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.643312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.643402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.643571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.643675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.643731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.643887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.645904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.646761] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646876] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.646943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.647146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.647225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.647403] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fb66480-86cf-42e4-9525-0dca27498295 is going to be updated. [ 1093.666658] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.666749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1093.666749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.666961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1093.667117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1093.667274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb66480-86cf-42e4-9525-0dca27498295" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1094.149322] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.652419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.652686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1094.652769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.653251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1094.653251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1094.653251] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 798082d0-32b4-40be-bc6c-1997cce6f121 is going to be created. [ 1094.674419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.674835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1094.674835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.675089] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1094.675282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1094.684599] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 798082d0-32b4-40be-bc6c-1997cce6f121 in Status: UNINITIALIZED for 2s [ 1095.334447] env[62815]: INFO networking_nsxv3.common.synchronization [req-9e55d5f4-4fdc-45d3-bcf4-77370f927520 req-dff9e529-ce30-4ad9-8377-d5a6f16d5eb5 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1095.335393] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1095.335873] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.336086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.336208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.336586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.336799] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.337012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.337090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.337324] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.337495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.339046] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.843360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.843554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.843649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.843888] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.843980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.844202] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.844276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.844337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.844480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.844552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.844635] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1095.867528] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.867662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1095.867737] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.868117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1095.868270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1095.876669] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1096.004767] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.004994] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.005155] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.005478] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.005743] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.005943] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.006079] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.006303] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.006459] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.006681] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.006858] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.006990] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.007123] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.007243] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.007354] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.007492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.026151] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.026338] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.026490] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.026674] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.027078] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.027246] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.027646] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.027860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.030226] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe28f0ec-7bf1-4eae-85ae-dd256a8ff606',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.531296] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.531631] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.531685] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.532053] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.532233] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.532434] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 not found, creating... [ 1096.532774] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.532932] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.533069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.533304] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.533449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.533823] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.534080] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.534169] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.534374] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.534513] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.534779] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 is going to be created. [ 1096.555514] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.555514] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.555514] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.555724] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.555957] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.556194] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.696202] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 798082d0-32b4-40be-bc6c-1997cce6f121 in Status: SUCCESS [ 1096.696434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.696666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.696894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.697125] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.697270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1096.697312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.697466] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1096.697577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.697628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1096.697721] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.200202] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.200448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.201047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.201378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.201650] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.201841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.201951] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.202199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.202332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.202465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.202762] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.202902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.203009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.204237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.204237] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.204237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.204237] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.204554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.204554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.204554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.204730] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.309072] env[62815]: INFO networking_nsxv3.common.synchronization [req-9e55d5f4-4fdc-45d3-bcf4-77370f927520 req-fae6b88d-f70b-4b89-bdeb-eeed658093e6 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1097.309274] env[62815]: INFO networking_nsxv3.common.synchronization [req-9e55d5f4-4fdc-45d3-bcf4-77370f927520 req-fae6b88d-f70b-4b89-bdeb-eeed658093e6 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1097.309428] env[62815]: INFO networking_nsxv3.common.synchronization [req-9e55d5f4-4fdc-45d3-bcf4-77370f927520 req-fae6b88d-f70b-4b89-bdeb-eeed658093e6 service nova] Enqueued Resource ID: fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 with Priority: HIGHEST for action port [ 1097.310288] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1097.310445] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1097.310552] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 with Priority: HIGHEST for action port [ 1097.311643] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.311643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.311643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.311643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.311643] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.312406] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.312514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.312857] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.312997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.313085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.313217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.313339] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe28f0ec-7bf1-4eae-85ae-dd256a8ff606',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.707624] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 798082d0-32b4-40be-bc6c-1997cce6f121: rpc.has_security_group_logging(os_id): False [ 1097.746805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.747080] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.747214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.747524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.747690] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.747996] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.748184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.748311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.748583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.748744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.749056] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.749216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.749334] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.749572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.749714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.750049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.750220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.750337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.750622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.750766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.750915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 798082d0-32b4-40be-bc6c-1997cce6f121 is going to be created. [ 1097.815522] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.815670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.815849] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 with status ACTIVE [ 1097.816088] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.816185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.816288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.816557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.816557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.816660] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.816756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.816787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.816924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.817035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.817188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.817276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.817376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.817497] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.817531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.817616] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe28f0ec-7bf1-4eae-85ae-dd256a8ff606 is going to be updated. [ 1097.843200] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.843401] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.843401] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.843694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.843937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.845849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.845972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.846047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.846250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.846397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.846616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe28f0ec-7bf1-4eae-85ae-dd256a8ff606" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.858553] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 798082d0-32b4-40be-bc6c-1997cce6f121 in Status: IN_PROGRESS for 2s [ 1097.889497] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1097.889701] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1097.889938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.890052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.890280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.890466] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.890580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1097.890642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.890793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1097.890877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1097.890972] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.392919] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.895874] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.398342] env[62815]: INFO networking_nsxv3.common.synchronization [req-b6a03344-375e-4243-8d8c-b3a1d88d8797 req-88df2959-6956-4ccd-9658-63f5b0b0467c tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1099.398764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.398923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.399058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.399224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.399316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.399841] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1099.401514] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGHEST for action security_group_members [ 1099.401856] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.401967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.402042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.402234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.402379] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.402475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.402529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.402730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.402819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.402903] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.438765] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.439026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.439026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.439451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.439534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.447750] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1099.869736] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 798082d0-32b4-40be-bc6c-1997cce6f121 in Status: SUCCESS [ 1099.869878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.905997] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.905997] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.906611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.906611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.906611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.907094] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.907094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.907296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.907337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.907426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.907507] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be updated. [ 1099.979505] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.979711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1099.979816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.980020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1099.980244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1099.992165] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: IN_PROGRESS for 2s [ 1100.272066] env[62815]: INFO networking_nsxv3.common.synchronization [req-fbd5b37a-af49-4606-bef8-6c604990aa69 req-95203b61-e30a-4110-bf16-88bb671ea4ba tempest-AttachVolumeTestJSON-444940362 tempest-AttachVolumeTestJSON-444940362-project-member] Enqueued Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_members [ 1100.272747] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 with Priority: HIGHEST for action security_group_members [ 1100.275216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.275376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.275446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.275660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.275834] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.275937] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.276007] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.276171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.276263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.276370] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.591447] env[62815]: INFO networking_nsxv3.common.synchronization [None req-b2e33f82-b901-44f9-a0f5-def4b7e57014 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_rules [ 1100.591447] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_rules [ 1100.591447] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.591447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.591447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.591447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.591447] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.706034] env[62815]: INFO networking_nsxv3.common.synchronization [req-a1b6febd-18f0-4907-b6d1-11efb8691149 req-dc01e628-d210-45a8-a2e6-3107044d4819 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1100.710262] env[62815]: INFO networking_nsxv3.common.synchronization [None req-12c76c84-54c2-4f3e-a37b-a5f670f4097c tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_rules [ 1100.710262] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1100.710262] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_rules [ 1100.710262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.710262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.710262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.710262] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.711554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.711666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.784635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.784856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.784972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.785303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.810164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.814019] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.814019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.814019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.814019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.814019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.814019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 is going to be updated. [ 1100.837100] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.837226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1100.837226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.837418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1100.837557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1100.845428] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 in Status: IN_PROGRESS for 2s [ 1101.113805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.116018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 already deleted. [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.116018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.116018] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.213847] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.216135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.216135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.216135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.219992] env[62815]: INFO networking_nsxv3.common.synchronization [req-521b2f96-1fe5-4dd3-ad43-b5f122153105 req-4ad39b69-8b5a-4111-a08a-e26f305b67fc tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_members [ 1101.221740] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGHEST for action security_group_members [ 1101.221740] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.221740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.221740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.222520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.224572] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.224572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.224572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.224572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.224572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.224572] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.236191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.236191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.236191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.236191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.236191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.236191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.236191] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1101.264767] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.264767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.264767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.264767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.264767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.277175] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1101.457750] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1101.457850] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.462160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.462160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.462160] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.462160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.462160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.462160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.462648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.462648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.462648] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.638045] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.638136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.638136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.639744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.639744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.639744] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 already deleted. [ 1101.639744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.728525] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.728699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.728777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.728988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.773813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.778036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.778036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.778036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.778036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.778036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.778036] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 is going to be updated. [ 1101.815427] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.815610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.815673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.815920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.816079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.827372] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97bb76de-5dc3-4e83-aabb-986627b27731 in Status: IN_PROGRESS for 2s [ 1101.965251] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.965251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.965251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.965519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.965605] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.965697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.966641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.966641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.966641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.966641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.966641] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.966641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.966641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.966976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.966976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.967178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1101.967255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.967477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1101.969036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.969036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1101.969036] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.002025] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b in Status: SUCCESS [ 1102.002206] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b deletion is rescheduled due to dependency. [ 1102.002316] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.471034] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933a2727-d7f2-415f-9a38-6d105996267c: rpc.has_security_group_logging(os_id): False [ 1102.490035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.490251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.490315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.490548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.490777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.491010] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.491126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.491233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.491366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.491455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.491677] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.491781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.491834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.491977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.493537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.493927] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.494073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.494153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.494313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.494389] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.494486] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1102.550121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.550272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1102.550369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.550618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1102.550769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1102.564227] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1102.860838] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 in Status: SUCCESS [ 1102.860838] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04 deletion is rescheduled due to dependency. [ 1102.860928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.286825] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1103.286825] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 deletion is rescheduled due to dependency. [ 1103.286825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.838018] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97bb76de-5dc3-4e83-aabb-986627b27731 in Status: SUCCESS [ 1103.838473] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 deletion is rescheduled due to dependency. [ 1103.838473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.878542] env[62815]: INFO networking_nsxv3.common.synchronization [None req-df6a9038-a986-4f86-98e8-c26765353f3b tempest-AttachInterfacesTestJSON-1410612943 tempest-AttachInterfacesTestJSON-1410612943-project-member] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1103.879152] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGHEST for action security_group_members [ 1103.879152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.879305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.879305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.879461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.879613] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.879707] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1103.879770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.879912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1103.879999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1103.880288] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.384599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.384599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.384599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.384599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.384599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.384599] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.384911] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.385619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.385706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.385751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.385831] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be updated. [ 1104.414557] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.414772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.414886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.415191] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.415442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.423575] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: IN_PROGRESS for 2s [ 1104.562680] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1104.562935] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_members [ 1104.563537] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1104.563712] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_members [ 1104.565847] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.566860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.567045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.567365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.567615] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.567810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.567927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.568172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.568339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.568521] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.569628] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.574198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.574275] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.574673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.574889] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.575613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.575613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.575613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.575613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.575613] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.592997] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1104.593274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1104.605105] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_rules [ 1104.605105] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_members [ 1104.605105] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_rules [ 1104.605105] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1104.605277] env[62815]: INFO networking_nsxv3.common.synchronization [req-32b3b685-4d62-4b1e-818a-91a5c1b34489 req-76999d29-9bda-4985-8b78-5d9c95e1bbe9 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc with Priority: HIGHEST for action port [ 1104.605784] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_rules [ 1104.605969] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_rules [ 1104.606163] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc with Priority: HIGHEST for action port [ 1104.606293] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_members [ 1104.606434] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1104.606728] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1193d7a3-3b9e-422e-9dde-e6088b40d7f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.606870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.606950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.607508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.607508] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.608385] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.609021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.609182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.609437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.610030] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.610430] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4dc61f-84fa-48be-837d-076b48b9b6fc taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.610594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.610693] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.610904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1104.611023] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4dc61f-84fa-48be-837d-076b48b9b6fc',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.611922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.612065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.612390] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.612563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.980022] env[62815]: INFO networking_nsxv3.common.synchronization [req-2d7f9906-e0a2-43e4-8a8a-b85374cfd7a0 req-fc2509f2-e543-4e5a-af1f-1fad34ea0a6f tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1104.980022] env[62815]: INFO networking_nsxv3.common.synchronization [req-2d7f9906-e0a2-43e4-8a8a-b85374cfd7a0 req-fc2509f2-e543-4e5a-af1f-1fad34ea0a6f tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_members [ 1104.980022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1104.980022] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 with Priority: HIGHEST for action security_group_members [ 1104.980022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.980681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1104.980994] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.981232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.079260] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.082225] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.085339] env[62815]: INFO networking_nsxv3.common.synchronization [req-2d7f9906-e0a2-43e4-8a8a-b85374cfd7a0 req-fc2509f2-e543-4e5a-af1f-1fad34ea0a6f tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_rules [ 1105.088000] env[62815]: INFO networking_nsxv3.common.synchronization [req-2d7f9906-e0a2-43e4-8a8a-b85374cfd7a0 req-fc2509f2-e543-4e5a-af1f-1fad34ea0a6f tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1105.088000] env[62815]: INFO networking_nsxv3.common.synchronization [req-2d7f9906-e0a2-43e4-8a8a-b85374cfd7a0 req-fc2509f2-e543-4e5a-af1f-1fad34ea0a6f tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc with Priority: HIGHEST for action port [ 1105.088000] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_rules [ 1105.088000] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1105.088000] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc with Priority: HIGHEST for action port [ 1105.088000] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.088000] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.088000] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.088000] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.088000] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4dc61f-84fa-48be-837d-076b48b9b6fc taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.088000] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.114253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.114253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.114253] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.114253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.117795] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b4dc61f-84fa-48be-837d-076b48b9b6fc with status ACTIVE [ 1105.117795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.117795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.117795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.117795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.117795] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc is going to be updated. [ 1105.137089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.137314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.137393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.137658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.137855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.138098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.138310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.138518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.138649] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4dc61f-84fa-48be-837d-076b48b9b6fc',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.583616] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.587699] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.641469] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b4dc61f-84fa-48be-837d-076b48b9b6fc with status ACTIVE [ 1105.641706] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.641842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.641915] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.642148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.642240] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.642421] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.642521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.642583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.642792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.642872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.643067] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.643169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.643221] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.643364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.643438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.643522] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b4dc61f-84fa-48be-837d-076b48b9b6fc is going to be updated. [ 1105.667020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.667020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1105.667020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.667020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1105.667020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1105.667020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4dc61f-84fa-48be-837d-076b48b9b6fc" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.085835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.085835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.085835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.085835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.085835] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.086595] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be updated. [ 1106.093891] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.093891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.093891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.093891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.093891] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.093891] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 is going to be created. [ 1106.110568] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.110568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.110568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.110568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.110568] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.113526] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.114738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.114738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.114738] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.115250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.128259] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 in Status: UNINITIALIZED for 2s [ 1106.129027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1106.432607] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 in Status: SUCCESS [ 1106.432773] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 deletion is rescheduled due to dependency. [ 1106.433071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.634559] env[62815]: INFO networking_nsxv3.common.synchronization [req-d55b4b59-d85c-49a3-b456-4183071a4bd9 req-21a3395f-58d6-46b9-9aec-d701f0347cd5 tempest-VolumesAdminNegativeTest-1112954704 tempest-VolumesAdminNegativeTest-1112954704-project-member] Enqueued Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_members [ 1106.635124] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGHEST for action security_group_members [ 1106.635880] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.640092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.640208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.640437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.640616] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.640740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1106.640802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.641058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1106.641183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1106.641183] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.144298] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.144636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.144636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.144740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.144898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.145051] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.145147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.145208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.145355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.145427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.145506] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 798082d0-32b4-40be-bc6c-1997cce6f121 is going to be updated. [ 1107.170974] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.172220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1107.172371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.172618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1107.172794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1107.189756] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 798082d0-32b4-40be-bc6c-1997cce6f121 in Status: IN_PROGRESS for 2s [ 1108.140465] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 in Status: SUCCESS [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.140465] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.140465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.140465] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.141658] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1108.141854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.141998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.142255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.142415] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.142518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.142583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.142775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.142861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.143021] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.645146] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.645588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.645588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.645588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.645794] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.645859] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.645956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.646151] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.646226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.646282] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.646384] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 is going to be deleted. [ 1108.647427] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.672127] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.672341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.672388] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.672645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.673239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.673239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.673239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.673380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.673642] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.673755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1108.673847] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.674049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1108.674147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1108.674314] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.149495] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.177020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.177020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.177020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.177020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.177020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.177020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.177295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.177295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.177295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.177492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.177492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 already deleted. [ 1109.177492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.177636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.177784] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.179485] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.179485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.179485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.179485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.179485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.179485] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.200185] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 798082d0-32b4-40be-bc6c-1997cce6f121 in Status: SUCCESS [ 1109.200357] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 798082d0-32b4-40be-bc6c-1997cce6f121 deletion is rescheduled due to dependency. [ 1109.200474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.653592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.653925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.653925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.653990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.654095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.654198] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be updated. [ 1109.680614] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.680830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.680932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.681202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.681297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.681492] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.681619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.681677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.682076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.682076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.682076] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 already deleted. [ 1109.682076] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.682233] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.683858] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.683975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1109.684056] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.684213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1109.684349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1109.692300] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1110.186101] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1193d7a3-3b9e-422e-9dde-e6088b40d7f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.573145] env[62815]: INFO networking_nsxv3.common.synchronization [req-53cde349-0760-4f5d-ad93-90bc099b21c5 req-4a7e3cfb-db0b-4a48-afd6-37aaa05b4903 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_members [ 1110.573145] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_members [ 1110.577393] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.577546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.577609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.577834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.577995] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.578116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.578172] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.578358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.578448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.578543] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.691939] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1193d7a3-3b9e-422e-9dde-e6088b40d7f9: rpc.has_security_group_logging(os_id): False [ 1110.709286] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.709492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.709723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.709777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.709848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.710067] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.710156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.710222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.710445] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.710558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.710558] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 is going to be created. [ 1110.723814] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1193d7a3-3b9e-422e-9dde-e6088b40d7f9], does not exist path=[/infra/domains/default/groups/1193d7a3-3b9e-422e-9dde-e6088b40d7f9]."\n}' [ 1110.723978] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1193d7a3-3b9e-422e-9dde-e6088b40d7f9 [ 1110.724076] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1110.759716] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.759881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.759957] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.760226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.763372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.763372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.763372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.763372] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1193d7a3-3b9e-422e-9dde-e6088b40d7f9 is going to be created. [ 1110.777196] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1193d7a3-3b9e-422e-9dde-e6088b40d7f9], does not exist path=[/infra/domains/default/groups/1193d7a3-3b9e-422e-9dde-e6088b40d7f9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1193d7a3-3b9e-422e-9dde-e6088b40d7f9 [ 1110.777346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1193d7a3-3b9e-422e-9dde-e6088b40d7f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.777697] env[62815]: Traceback (most recent call last): [ 1110.777697] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1110.777697] env[62815]: return func(*args, **kwargs) [ 1110.777697] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1110.777697] env[62815]: res.raise_for_status() [ 1110.777697] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1110.777697] env[62815]: raise HTTPError(http_error_msg, response=self) [ 1110.777697] env[62815]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1193d7a3-3b9e-422e-9dde-e6088b40d7f9 [ 1110.777697] env[62815]: During handling of the above exception, another exception occurred: [ 1110.777697] env[62815]: Traceback (most recent call last): [ 1110.777697] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1110.777697] env[62815]: listener.cb(fileno) [ 1110.777697] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1110.777697] env[62815]: result = function(*args, **kwargs) [ 1110.777697] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1110.777697] env[62815]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1110.777697] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1110.777697] env[62815]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1110.777697] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1110.777697] env[62815]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1110.777697] env[62815]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1110.777697] env[62815]: res.raise_for_status() [ 1110.777697] env[62815]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1110.777697] env[62815]: raise HTTPError(http_error_msg, response=self) [ 1110.777697] env[62815]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1193d7a3-3b9e-422e-9dde-e6088b40d7f9 [ 1110.777697] env[62815]: Removing descriptor: 29 [ 1110.944173] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.944417] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.944548] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.944900] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.945197] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.945792] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.945792] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.945792] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.945938] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.946205] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.946335] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.946452] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.946577] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.947872] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.947872] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.947872] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.964514] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.964778] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.964942] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.965165] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1110.965483] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-70ea58fc-e76c-4d8e-94bc-580d3216aafb taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.965677] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1110.965893] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.966210] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1110.966365] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ea58fc-e76c-4d8e-94bc-580d3216aafb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.080788] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.081101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.081173] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.081372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.081477] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.081679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.081796] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.081842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.081976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.082084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.082246] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 already deleted. [ 1111.082305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.470439] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.470608] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.470801] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.471237] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.471488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.471758] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 70ea58fc-e76c-4d8e-94bc-580d3216aafb not found, creating... [ 1111.472192] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.472454] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.472663] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.473055] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.473306] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.473769] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.474054] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.474452] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.474612] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.474860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.475123] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 70ea58fc-e76c-4d8e-94bc-580d3216aafb is going to be created. [ 1111.496067] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.496067] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.496067] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.498437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.498437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.498437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.701462] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1111.701783] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.701836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.702069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.702254] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.702367] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1111.702435] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.702584] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1111.702667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1111.702800] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.772136] env[62815]: INFO networking_nsxv3.common.synchronization [req-889867fc-0897-4b68-bb8d-0304b4c4a0fd req-2e6d1be2-f643-40e7-b4ba-9830c66b36c2 tempest-ServerRescueTestJSONUnderV235-1341295036 tempest-ServerRescueTestJSONUnderV235-1341295036-project-member] Enqueued Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1111.772694] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 with Priority: HIGHEST for action security_group_members [ 1111.774880] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.774986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.205137] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.276950] env[62815]: INFO networking_nsxv3.common.synchronization [req-53cde349-0760-4f5d-ad93-90bc099b21c5 req-5c2d3219-4160-4998-b43d-a64c404fadd8 service nova] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_rules [ 1112.277135] env[62815]: INFO networking_nsxv3.common.synchronization [req-53cde349-0760-4f5d-ad93-90bc099b21c5 req-5c2d3219-4160-4998-b43d-a64c404fadd8 service nova] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_members [ 1112.277379] env[62815]: INFO networking_nsxv3.common.synchronization [req-53cde349-0760-4f5d-ad93-90bc099b21c5 req-5c2d3219-4160-4998-b43d-a64c404fadd8 service nova] Enqueued Resource ID: 70ea58fc-e76c-4d8e-94bc-580d3216aafb with Priority: HIGHEST for action port [ 1112.277688] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_rules [ 1112.277848] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_members [ 1112.278044] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70ea58fc-e76c-4d8e-94bc-580d3216aafb with Priority: HIGHEST for action port [ 1112.279593] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.279593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.279593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.279593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.279593] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.280498] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.280709] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.281245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.281245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.281245] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.281573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.281956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.282341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.282341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.282450] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.283499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-70ea58fc-e76c-4d8e-94bc-580d3216aafb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.283499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.283499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.284247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.284360] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ea58fc-e76c-4d8e-94bc-580d3216aafb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.707009] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.786167] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70ea58fc-e76c-4d8e-94bc-580d3216aafb with status ACTIVE [ 1112.786413] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.786549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.786622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.786834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.786935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.787123] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.787207] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.787286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.787428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.787503] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.787674] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.787761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.787820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.787963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.788047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.788133] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70ea58fc-e76c-4d8e-94bc-580d3216aafb is going to be updated. [ 1112.789296] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.789410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.789543] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.812379] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.812544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1112.812602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.812820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1112.812958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1112.813157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70ea58fc-e76c-4d8e-94bc-580d3216aafb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.210101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.210101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.210101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.210366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.210366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.210366] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be updated. [ 1113.234576] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.234767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.234767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.235033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.235169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.243982] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1113.292067] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.797678] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.798057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.798057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.798185] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.798347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.798480] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 is going to be created. [ 1113.821118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.821298] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1113.821340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.821591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1113.821778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1113.830073] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 in Status: UNINITIALIZED for 2s [ 1114.607132] env[62815]: INFO networking_nsxv3.common.synchronization [req-71241e3b-25fb-4833-a178-2afda3428efa req-573e045d-6cfc-426c-b103-5c65c012dcd1 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1114.607132] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1114.607623] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.607623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.607623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.607623] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.607803] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.607803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.607803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.607973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.608325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.608462] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.948755] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.949125] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.949125] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.949416] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.949678] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.949847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.950060] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.950342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.950520] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.950815] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.951023] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.951167] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.951288] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.951411] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.951524] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.951665] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.968493] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.968799] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.968895] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.969011] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1114.969320] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-4da0739e-5af8-4beb-94a9-9f098b81bf02 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.969496] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1114.969624] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.969949] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1114.970110] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da0739e-5af8-4beb-94a9-9f098b81bf02',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.111039] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.111236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.111236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.111405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.130446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.130700] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.130830] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.130898] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.131115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.131197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.131287] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1115.152790] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.153034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.153138] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.153357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.153500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.161109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1115.254467] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1115.254691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.254855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.255099] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.255292] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.255436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.255510] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.255666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.255745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.255839] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.473066] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.473066] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.473066] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.473338] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.473580] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.473618] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 4da0739e-5af8-4beb-94a9-9f098b81bf02 not found, creating... [ 1115.473916] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.474119] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.474396] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.474618] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.474796] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.475127] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.475292] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.475421] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.475676] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.475817] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.475986] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 is going to be created. [ 1115.498259] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.498509] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.498654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.498934] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.499191] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.499428] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.758633] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.758804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.758878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.759111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.780253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.780498] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.780645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.780723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.781123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.781123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.781123] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be updated. [ 1115.804622] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.804788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.804848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.805060] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.805202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.813397] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1115.839060] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 in Status: SUCCESS [ 1115.839158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.839295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.839580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.839707] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.839822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1115.839990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.840065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1115.840365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.840365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1115.840365] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.220858] env[62815]: INFO networking_nsxv3.common.synchronization [req-71241e3b-25fb-4833-a178-2afda3428efa req-4176ad82-6cbc-41ce-a09e-2ac1162cfc75 service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 1116.221126] env[62815]: INFO networking_nsxv3.common.synchronization [req-71241e3b-25fb-4833-a178-2afda3428efa req-4176ad82-6cbc-41ce-a09e-2ac1162cfc75 service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1116.221215] env[62815]: INFO networking_nsxv3.common.synchronization [req-71241e3b-25fb-4833-a178-2afda3428efa req-4176ad82-6cbc-41ce-a09e-2ac1162cfc75 service nova] Enqueued Resource ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 with Priority: HIGHEST for action port [ 1116.221443] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 1116.221572] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1116.221669] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 with Priority: HIGHEST for action port [ 1116.222341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.222456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.222525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.222750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.222830] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.224335] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.224335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.224428] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4da0739e-5af8-4beb-94a9-9f098b81bf02 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.224558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.224692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.224789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.224864] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da0739e-5af8-4beb-94a9-9f098b81bf02',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.342783] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.725448] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.725689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.726998] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4da0739e-5af8-4beb-94a9-9f098b81bf02 with status ACTIVE [ 1116.727333] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.727490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.727571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.727800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.727896] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.728103] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.728205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.728263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.728423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.728495] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.728684] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.728769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.728831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.728979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.729062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.729148] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 is going to be updated. [ 1116.752023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.752223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.752223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.752438] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.752581] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.752790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.845598] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc8ead0f-ce38-4f18-ae1d-b6c8d8602981: rpc.has_security_group_logging(os_id): False [ 1116.870634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.870860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.870938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.871195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.871303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.871634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.871803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.871939] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.872090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.872196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.872196] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 is going to be created. [ 1116.948301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.948606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1116.948606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.948745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1116.948906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1116.960390] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 in Status: IN_PROGRESS for 2s [ 1117.171054] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1117.171282] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 deletion is rescheduled due to dependency. [ 1117.171559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.171767] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.172143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.172498] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.172845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.172976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.173346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.173518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.174061] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.676404] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.826193] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1117.826329] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 deletion is rescheduled due to dependency. [ 1117.826418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.826579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.826809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.827053] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.827121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.827803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.827803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.827803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.827803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.827803] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.830103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.830352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.830573] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.830686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1117.830758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.830905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1117.831016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1117.831094] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.179622] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.194359] env[62815]: INFO networking_nsxv3.common.synchronization [req-957829b3-a1e4-4840-8d9a-d7d4f074fe24 req-c7cdfca7-a0f3-474c-9d40-fef6c2002c2b tempest-VolumesAdminNegativeTest-1112954704 tempest-VolumesAdminNegativeTest-1112954704-project-member] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_members [ 1118.195773] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGHEST for action security_group_members [ 1118.196199] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.196534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.196606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.196820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.196986] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.197103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.197167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.197378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.197426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.197497] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.333236] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.333403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.339269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.339434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.339506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.339684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.339776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.340064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.340160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.340160] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.340289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.340366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.340447] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be updated. [ 1118.366194] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.366362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.366443] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.366626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.366762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.375186] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1118.682635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.682960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.682960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.683171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.683255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.683303] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1118.700440] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.700570] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.700747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.700905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.732252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.732558] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.732650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.732687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.732987] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.733038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.733114] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda is going to be updated. [ 1118.735755] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.735755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.735755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.735755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.735755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.745120] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1118.769903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.770054] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1118.770121] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.770322] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1118.770530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1118.788075] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: IN_PROGRESS for 2s [ 1118.973126] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 in Status: SUCCESS [ 1118.973988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.385039] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1120.385374] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 deletion is rescheduled due to dependency. [ 1120.385374] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.385491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.385639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.385837] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.385956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.386040] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.386189] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.386274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.386360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.386512] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.386604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.386727] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.386833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.386976] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.387120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.387184] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.387327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.387403] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.387618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.387618] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.754098] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1120.754321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.754484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.754710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.754898] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.755022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.755087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.755238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.755317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.755400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.755489] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.799054] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57828e0d-c3cb-4556-9802-017ac3330eda in Status: SUCCESS [ 1120.799247] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda deletion is rescheduled due to dependency. [ 1120.799361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.890360] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd95b1fd-fc85-4df7-9a92-a110a9bd60e5: rpc.has_security_group_logging(os_id): False [ 1120.907088] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.907264] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.907307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.907534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.907602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.907791] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.907881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.907948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.908117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.908205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.908392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.908484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.908545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.908685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.908833] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.909071] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.909218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.909313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.909538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.909681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.909765] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be updated. [ 1120.965470] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.965636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1120.965682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.966038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1120.966242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1120.979530] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: IN_PROGRESS for 2s [ 1121.258197] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.762247] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2840bf9-b592-4644-bcf1-bd4ca72a79e5: rpc.has_security_group_logging(os_id): False [ 1121.780893] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.781090] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.781153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.781314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.781402] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.781632] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.781729] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.781792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.781940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.782031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.782119] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1121.839040] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.839230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1121.839230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.839375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1121.839532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1121.852199] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1122.205493] env[62815]: INFO networking_nsxv3.common.synchronization [req-1f4d8dfa-4e5a-4061-bda8-1736f8f1b19b req-5ce4f8b8-5fc4-4aec-81e8-49666cb9b593 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1122.205493] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1122.205771] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.205894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.205960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.206400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.206570] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.206670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.206730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.206881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.206996] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.207605] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.711791] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.712052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.712148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.712569] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.737241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.737489] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.737603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.737669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.737872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.737954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.738056] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1122.782969] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.783342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1122.783342] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.783412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.783529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.792311] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1122.991725] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 in Status: SUCCESS [ 1122.991975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1122.992464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.992686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1122.992806] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd95b1fd-fc85-4df7-9a92-a110a9bd60e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.512954] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.513162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.513228] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.513430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.513546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.513689] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd95b1fd-fc85-4df7-9a92-a110a9bd60e5 is going to be deleted. [ 1123.562804] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.562983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1123.563065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.563242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1123.563368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.563496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd95b1fd-fc85-4df7-9a92-a110a9bd60e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1123.866505] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1123.866788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1124.802222] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1124.802447] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1124.802588] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.207985] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.207985] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1127.442016] env[62815]: INFO networking_nsxv3.common.synchronization [req-89c5dcfa-2d35-46cb-b81f-3e10a9f18450 req-52403dbf-dcf3-495a-9a94-f14b7ab7b53d tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_members [ 1127.442631] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGHEST for action security_group_members [ 1127.443011] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.443501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.443575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.443788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.443945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.444178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.444178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.444471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.444614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.444674] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.947443] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.947601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.947677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.947912] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.971841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.972097] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.972209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1127.972267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.972458] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1127.972717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1127.972717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb is going to be updated. [ 1128.001501] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.001879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.001879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.002364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.002530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.013053] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: IN_PROGRESS for 2s [ 1128.304886] env[62815]: INFO networking_nsxv3.common.synchronization [None req-fc2a4d30-42af-40ac-8ceb-2f1230268b43 None None] Enqueued Resource ID: b468a930-ce01-4f44-9bb8-18af6a9af0ca with Priority: HIGHEST for action port [ 1128.305173] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b468a930-ce01-4f44-9bb8-18af6a9af0ca with Priority: HIGHEST for action port [ 1128.305727] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b468a930-ce01-4f44-9bb8-18af6a9af0ca taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.305848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b468a930-ce01-4f44-9bb8-18af6a9af0ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.305916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b468a930-ce01-4f44-9bb8-18af6a9af0ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.306271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b468a930-ce01-4f44-9bb8-18af6a9af0ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.306355] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b468a930-ce01-4f44-9bb8-18af6a9af0ca',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.809345] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b468a930-ce01-4f44-9bb8-18af6a9af0ca [ 1128.810318] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.810318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1128.810318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.810318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1128.810318] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1128.810318] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b468a930-ce01-4f44-9bb8-18af6a9af0ca already deleted. [ 1128.810619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b468a930-ce01-4f44-9bb8-18af6a9af0ca" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.023577] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb in Status: SUCCESS [ 1130.023873] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb deletion is rescheduled due to dependency. [ 1130.023933] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.384505] env[62815]: INFO networking_nsxv3.common.synchronization [None req-fbb1873b-8967-4295-99f3-0f4575cf2dda None None] Enqueued Resource ID: 8e5d0d48-378e-4fa8-9894-4358fb4ba145 with Priority: HIGHEST for action port [ 1130.384775] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5d0d48-378e-4fa8-9894-4358fb4ba145 with Priority: HIGHEST for action port [ 1130.385354] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e5d0d48-378e-4fa8-9894-4358fb4ba145 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.385488] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e5d0d48-378e-4fa8-9894-4358fb4ba145" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.385557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e5d0d48-378e-4fa8-9894-4358fb4ba145" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.385800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e5d0d48-378e-4fa8-9894-4358fb4ba145" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.385885] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e5d0d48-378e-4fa8-9894-4358fb4ba145',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.889170] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e5d0d48-378e-4fa8-9894-4358fb4ba145 [ 1130.889411] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.889549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1130.889619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.889831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1130.889927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1130.890038] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e5d0d48-378e-4fa8-9894-4358fb4ba145 already deleted. [ 1130.890123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e5d0d48-378e-4fa8-9894-4358fb4ba145" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1131.675490] env[62815]: INFO networking_nsxv3.common.synchronization [None req-9bfa8afa-0a0a-4406-8fdf-cd49f93ff544 None None] Enqueued Resource ID: 7d2f538a-931d-4d18-a8b4-89410697e419 with Priority: HIGHEST for action port [ 1131.675855] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d2f538a-931d-4d18-a8b4-89410697e419 with Priority: HIGHEST for action port [ 1131.676065] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d2f538a-931d-4d18-a8b4-89410697e419 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.676201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d2f538a-931d-4d18-a8b4-89410697e419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1131.676272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d2f538a-931d-4d18-a8b4-89410697e419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.676514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d2f538a-931d-4d18-a8b4-89410697e419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1131.676598] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d2f538a-931d-4d18-a8b4-89410697e419',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.179064] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d2f538a-931d-4d18-a8b4-89410697e419 [ 1132.179270] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.179372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1132.179429] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.179656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1132.179786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1132.179921] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d2f538a-931d-4d18-a8b4-89410697e419 already deleted. [ 1132.180020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d2f538a-931d-4d18-a8b4-89410697e419" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1133.908135] env[62815]: INFO networking_nsxv3.common.synchronization [None req-2ad38270-79c7-45ae-a02a-09818807e12f None None] Enqueued Resource ID: 738c6c75-94e4-4caa-8cc5-fbba27d2975d with Priority: HIGHEST for action port [ 1133.908469] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738c6c75-94e4-4caa-8cc5-fbba27d2975d with Priority: HIGHEST for action port [ 1133.908956] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-738c6c75-94e4-4caa-8cc5-fbba27d2975d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.909098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738c6c75-94e4-4caa-8cc5-fbba27d2975d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1133.909167] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738c6c75-94e4-4caa-8cc5-fbba27d2975d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.909427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738c6c75-94e4-4caa-8cc5-fbba27d2975d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1133.909510] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738c6c75-94e4-4caa-8cc5-fbba27d2975d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.121293] env[62815]: INFO networking_nsxv3.common.synchronization [None req-80fe280d-f2a3-4437-be2e-ddf4a8dd4932 None None] Enqueued Resource ID: 65e6192a-ba9b-4136-8aab-2d518eaa41b4 with Priority: HIGHEST for action port [ 1134.121449] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e6192a-ba9b-4136-8aab-2d518eaa41b4 with Priority: HIGHEST for action port [ 1134.122093] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-65e6192a-ba9b-4136-8aab-2d518eaa41b4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.122343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65e6192a-ba9b-4136-8aab-2d518eaa41b4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.122460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65e6192a-ba9b-4136-8aab-2d518eaa41b4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.122875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65e6192a-ba9b-4136-8aab-2d518eaa41b4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.122964] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65e6192a-ba9b-4136-8aab-2d518eaa41b4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.412020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 738c6c75-94e4-4caa-8cc5-fbba27d2975d [ 1134.412252] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.412463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.412564] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.412788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.413041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.413190] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:738c6c75-94e4-4caa-8cc5-fbba27d2975d already deleted. [ 1134.413297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738c6c75-94e4-4caa-8cc5-fbba27d2975d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.448224] env[62815]: INFO networking_nsxv3.common.synchronization [req-07840f90-5912-404d-af67-57786522c119 req-ffed658a-e25a-41b9-a3ee-0d2c8e1f91cb tempest-InstanceActionsNegativeTestJSON-224598625 tempest-InstanceActionsNegativeTestJSON-224598625-project-member] Enqueued Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_members [ 1134.448737] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_members [ 1134.449047] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.449447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.449447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.449563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.449681] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.449801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.450079] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.450247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.450331] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.450483] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.625360] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65e6192a-ba9b-4136-8aab-2d518eaa41b4 [ 1134.625592] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.625730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.625798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.626034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.626132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.626230] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65e6192a-ba9b-4136-8aab-2d518eaa41b4 already deleted. [ 1134.626312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65e6192a-ba9b-4136-8aab-2d518eaa41b4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.821121] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.821121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-863" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.821121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-863" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.821121] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-863" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.821842] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.822250] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.822617] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.823102] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.823456] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.824381] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.825947] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.825947] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.825947] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.825947] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.825947] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.825947] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.848022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.848022] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1134.848022] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.848022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-863" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.848022] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-70d2d720-1519-4aec-be64-cf522bddc8ab taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.848022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.848022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.848022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.848022] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d2d720-1519-4aec-be64-cf522bddc8ab',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.953919] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.953919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.953919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.953919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.953919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.953919] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.953919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1134.954520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.954520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1134.954520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1134.954520] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb already deleted. [ 1134.954520] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.350472] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.350720] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.350880] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.351267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.351445] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.351610] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 70d2d720-1519-4aec-be64-cf522bddc8ab not found, creating... [ 1135.351886] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.352120] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.352266] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.352505] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.352652] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.353033] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.353221] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.353355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.353571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.353714] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.353861] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 70d2d720-1519-4aec-be64-cf522bddc8ab is going to be created. [ 1135.376131] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.376353] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1135.376485] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.376763] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1135.377008] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1135.377285] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.075468] env[62815]: INFO networking_nsxv3.common.synchronization [req-07840f90-5912-404d-af67-57786522c119 req-634151b7-d476-42b4-99bd-6f868291a498 service nova] Enqueued Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_rules [ 1136.075468] env[62815]: INFO networking_nsxv3.common.synchronization [req-07840f90-5912-404d-af67-57786522c119 req-634151b7-d476-42b4-99bd-6f868291a498 service nova] Enqueued Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_members [ 1136.075468] env[62815]: INFO networking_nsxv3.common.synchronization [req-07840f90-5912-404d-af67-57786522c119 req-634151b7-d476-42b4-99bd-6f868291a498 service nova] Enqueued Resource ID: 70d2d720-1519-4aec-be64-cf522bddc8ab with Priority: HIGHEST for action port [ 1136.075920] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_rules [ 1136.076138] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_members [ 1136.076209] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70d2d720-1519-4aec-be64-cf522bddc8ab with Priority: HIGHEST for action port [ 1136.076537] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.076640] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.077058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.077058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.077058] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.078376] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.078513] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.078580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.079276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.079276] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.079276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.079276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.079276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.079613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.079613] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.080993] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-70d2d720-1519-4aec-be64-cf522bddc8ab taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.081109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.081174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.081387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.081431] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d2d720-1519-4aec-be64-cf522bddc8ab',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.316173] env[62815]: INFO networking_nsxv3.common.synchronization [None req-d2f613a1-3b84-40b9-8951-8d7b91de7896 None None] Enqueued Resource ID: f37c696d-4ec3-48b8-a035-4449a3c95229 with Priority: HIGHEST for action port [ 1136.316173] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37c696d-4ec3-48b8-a035-4449a3c95229 with Priority: HIGHEST for action port [ 1136.316894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-f37c696d-4ec3-48b8-a035-4449a3c95229 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.317168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f37c696d-4ec3-48b8-a035-4449a3c95229" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.317168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f37c696d-4ec3-48b8-a035-4449a3c95229" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.317405] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f37c696d-4ec3-48b8-a035-4449a3c95229" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.318059] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f37c696d-4ec3-48b8-a035-4449a3c95229',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.583748] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.584877] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.584985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.585136] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70d2d720-1519-4aec-be64-cf522bddc8ab with status ACTIVE [ 1136.585301] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.585455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.585499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.585683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.585750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.585930] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.586015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.586122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.586248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.586295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.586488] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.586612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.586671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.586854] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.586889] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.586964] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70d2d720-1519-4aec-be64-cf522bddc8ab is going to be updated. [ 1136.607306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.607594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.607594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.607761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.607909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.608084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70d2d720-1519-4aec-be64-cf522bddc8ab" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.796065] env[62815]: INFO networking_nsxv3.common.synchronization [req-448f2471-c437-436c-82bc-eaa004f47c7a req-7ea3add3-869d-4744-ad72-066ecb902406 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1136.796610] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1136.796920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.797073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.797143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.797347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.797500] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.797597] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.797654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.797932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.797932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.798202] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.819401] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f37c696d-4ec3-48b8-a035-4449a3c95229 [ 1136.819635] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.819818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1136.819908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.820070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1136.820171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1136.820260] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f37c696d-4ec3-48b8-a035-4449a3c95229 already deleted. [ 1136.820717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f37c696d-4ec3-48b8-a035-4449a3c95229" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.089527] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.273192] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.273350] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.273468] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.273748] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.274299] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.275288] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.275499] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.275772] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.275936] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.276213] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.276335] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.276451] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.276582] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.276707] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.276821] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.276961] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.297948] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.298158] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.298309] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.298517] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.298854] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-1ae0668f-ed7a-4745-a713-1f0cb4735f93 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.299067] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.299199] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.299573] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.299734] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ae0668f-ed7a-4745-a713-1f0cb4735f93',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.301787] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.301929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.302012] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.302241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.302332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.302538] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.302641] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.302705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.302927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.303082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.303182] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1137.329489] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.329662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.329735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.329974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.330137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.338566] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1137.593256] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.593469] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.593576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.593827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.593945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.594068] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb is going to be created. [ 1137.616499] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.616724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.616724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.616938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.617112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.626104] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb in Status: UNINITIALIZED for 2s [ 1137.805917] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.806147] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.806268] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.806627] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.806800] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.807019] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 1ae0668f-ed7a-4745-a713-1f0cb4735f93 not found, creating... [ 1137.807362] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.807536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.807663] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.807901] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.808090] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.808409] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.808574] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.808706] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.808921] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.809110] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.809276] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 1ae0668f-ed7a-4745-a713-1f0cb4735f93 is going to be created. [ 1137.832395] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.832586] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1137.832716] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.833119] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1137.833400] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1137.833648] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1138.541326] env[62815]: INFO networking_nsxv3.common.synchronization [req-448f2471-c437-436c-82bc-eaa004f47c7a req-0ff51740-d3e4-4e4f-ab12-df0aa40d2251 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1138.541549] env[62815]: INFO networking_nsxv3.common.synchronization [req-448f2471-c437-436c-82bc-eaa004f47c7a req-0ff51740-d3e4-4e4f-ab12-df0aa40d2251 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1138.541648] env[62815]: INFO networking_nsxv3.common.synchronization [req-448f2471-c437-436c-82bc-eaa004f47c7a req-0ff51740-d3e4-4e4f-ab12-df0aa40d2251 service nova] Enqueued Resource ID: 1ae0668f-ed7a-4745-a713-1f0cb4735f93 with Priority: HIGHEST for action port [ 1138.541876] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1138.542029] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1138.542141] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae0668f-ed7a-4745-a713-1f0cb4735f93 with Priority: HIGHEST for action port [ 1138.542673] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.542771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.542855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.543243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.543331] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.544230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.544575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.545687] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ae0668f-ed7a-4745-a713-1f0cb4735f93 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.545687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1138.545687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.545687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1138.545687] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ae0668f-ed7a-4745-a713-1f0cb4735f93',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.046998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.047178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.048023] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ae0668f-ed7a-4745-a713-1f0cb4735f93 with status ACTIVE [ 1139.048023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.048023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.048023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.048023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.048023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.048354] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.048354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.048354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.048472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.048505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.048671] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.048765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.048826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.048976] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.049111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.049236] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ae0668f-ed7a-4745-a713-1f0cb4735f93 is going to be updated. [ 1139.069861] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.070018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.070088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.070293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.070424] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.070603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ae0668f-ed7a-4745-a713-1f0cb4735f93" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.350900] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1139.351233] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1139.351351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.351505] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.351736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.351921] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.352052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.352124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.352262] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.352340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.352436] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.636016] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb in Status: SUCCESS [ 1139.636016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.636358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.636358] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.636464] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.636575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.636638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.636779] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.636856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.637842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.637842] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.855854] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.924726] env[62815]: INFO networking_nsxv3.common.synchronization [req-5a0e2b73-49eb-4d7a-bf2d-28b6796f090c req-25a304fe-8452-4376-a181-6ef741fd5e24 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 1139.925279] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 1139.926033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.926033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.926033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.926033] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.926247] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.926247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1139.926341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.926391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1139.927022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1139.927022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.139645] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.139645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.139927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.140201] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.140461] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.140585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.140655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.140825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.140930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.141047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.141272] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.141394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.141441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.141557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.141695] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.141809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.141920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.142103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.142196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.142307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.142412] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.284698] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.284920] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.285069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.285408] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.285684] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.285961] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.286139] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.286430] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.286625] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.286896] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.287033] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.287155] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.287267] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.287382] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.287514] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.287654] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.305796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.305976] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.306141] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.306320] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.306636] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-1128e803-1194-4bac-b14d-17c9727426f6 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.306808] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.306932] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.307285] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.307423] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1128e803-1194-4bac-b14d-17c9727426f6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.357697] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.429074] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.429074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.429074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.429074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.449019] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.449275] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.449396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.449464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.449682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.449770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.449875] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be updated. [ 1140.476345] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.477483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.477483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.477483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.477483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.491032] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: IN_PROGRESS for 2s [ 1140.644965] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96ccef0c-31fb-4177-add9-d374ddad2ddb: rpc.has_security_group_logging(os_id): False [ 1140.665694] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.665894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.665950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.666212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.666311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.666515] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.666603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.666672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.666826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.666913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.667130] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.667305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.667355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.667593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.667749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.668064] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.668250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.668369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.668615] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.668758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.668909] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb is going to be created. [ 1140.739560] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.739778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.739864] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.740144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.740361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.751041] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb in Status: IN_PROGRESS for 2s [ 1140.809316] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.811171] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 1128e803-1194-4bac-b14d-17c9727426f6 not found, creating... [ 1140.811171] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.811171] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.811534] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.811534] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.811701] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.811926] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.812220] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.812406] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.812584] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 1128e803-1194-4bac-b14d-17c9727426f6 is going to be created. [ 1140.830664] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.830923] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.831115] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.831476] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.831679] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.832051] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.860522] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.860748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.860853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.861049] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.861154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.861261] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1140.921041] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.921258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1140.921258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.921411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1140.921592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1140.929803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1141.550390] env[62815]: INFO networking_nsxv3.common.synchronization [req-5a0e2b73-49eb-4d7a-bf2d-28b6796f090c req-13c7ff0a-afff-40dd-8096-f91cf7e18019 service nova] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_rules [ 1141.550518] env[62815]: INFO networking_nsxv3.common.synchronization [req-5a0e2b73-49eb-4d7a-bf2d-28b6796f090c req-13c7ff0a-afff-40dd-8096-f91cf7e18019 service nova] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 1141.550700] env[62815]: INFO networking_nsxv3.common.synchronization [req-5a0e2b73-49eb-4d7a-bf2d-28b6796f090c req-13c7ff0a-afff-40dd-8096-f91cf7e18019 service nova] Enqueued Resource ID: 1128e803-1194-4bac-b14d-17c9727426f6 with Priority: HIGHEST for action port [ 1141.553134] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_rules [ 1141.553134] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 1141.553134] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1128e803-1194-4bac-b14d-17c9727426f6 with Priority: HIGHEST for action port [ 1141.553134] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.553134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.553134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.553573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.553573] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.554922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.554922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.555125] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1128e803-1194-4bac-b14d-17c9727426f6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.555196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1141.555261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.555698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1141.555698] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1128e803-1194-4bac-b14d-17c9727426f6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.059392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.059392] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1128e803-1194-4bac-b14d-17c9727426f6 with status ACTIVE [ 1142.059392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.059392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.059392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.059985] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.059985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.059985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.059985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.059985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.060159] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1128e803-1194-4bac-b14d-17c9727426f6 is going to be updated. [ 1142.081952] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.082129] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.082190] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.082415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.082563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.082740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.500038] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 1142.500739] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 deletion is rescheduled due to dependency. [ 1142.500739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.500739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.500739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.500964] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.501088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.501127] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.501281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.501386] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.501491] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.774842] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb in Status: SUCCESS [ 1142.775113] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.946685] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1142.946907] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.947289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.947416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.947532] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.947650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1142.947716] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.947875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1142.947959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.948071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1142.948160] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.004121] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.452132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.452132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.452132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.452132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.452132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.452132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.452132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.452132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.452712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.452712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.452712] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.452712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.452712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.452712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.452898] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.452958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.452991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.453137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.453214] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.453294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.453384] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.507042] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.955598] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933a2727-d7f2-415f-9a38-6d105996267c: rpc.has_security_group_logging(os_id): False [ 1143.973916] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.974142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.974199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.974391] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.974483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.974679] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.974777] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.974840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.974994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.975086] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.975281] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.975376] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.975439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.975604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.975702] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.975828] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.975938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1143.975998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.976159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1143.976226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1143.976315] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1144.008539] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.008705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.008789] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.009055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.009168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.009390] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be updated. [ 1144.038150] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.038332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.038425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.038601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.038748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.040716] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.040815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.040927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.041051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.041225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.049803] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: IN_PROGRESS for 2s [ 1144.055006] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1144.619388] env[62815]: INFO networking_nsxv3.common.synchronization [req-380cc216-f4dc-4416-8052-67b8ff995c83 req-5fb92173-5a6f-4a40-9e87-9e5e462be341 tempest-ServersNegativeTestMultiTenantJSON-829057627 tempest-ServersNegativeTestMultiTenantJSON-829057627-project-member] Enqueued Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_members [ 1144.619900] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_members [ 1144.620213] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.620338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.620404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.620657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.620922] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.621047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.621572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.621745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.621836] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.621930] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.896767] env[62815]: INFO networking_nsxv3.common.synchronization [req-093e116f-b5e2-4839-bcf2-769d5ae3be27 req-d48cb88a-120e-4698-a5ab-a87a852c15f0 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1144.897296] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1144.897625] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.897782] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.898017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.898136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.898298] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.898579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1144.898579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.898682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1144.898682] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1144.898830] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.124183] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.124383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.124451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.124630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.124723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.124998] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.124998] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.128148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.128148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.128148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.128148] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 already deleted. [ 1145.128148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.269020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-779" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-779" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-779" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.269020] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.269020] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.269545] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.269786] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.270027] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.270337] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.270562] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.270775] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.271074] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.289142] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.289646] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.289934] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.290242] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-779" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.290657] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-896ac8e3-b440-490d-900d-d20ecda6fa9f taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.292107] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.292107] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.292107] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.292107] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896ac8e3-b440-490d-900d-d20ecda6fa9f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.403346] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.403346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.403346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.403346] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.424534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.424534] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.424534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.424534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.424534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.424534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.424534] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1145.453283] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.453283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.453283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.453283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.453283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.459821] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1145.794213] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.794568] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.794621] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.794925] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.795114] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.795288] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 896ac8e3-b440-490d-900d-d20ecda6fa9f not found, creating... [ 1145.795559] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.795727] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.795850] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.796105] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.796254] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.796537] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.796698] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.796822] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.797052] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.797195] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.797337] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 896ac8e3-b440-490d-900d-d20ecda6fa9f is going to be created. [ 1145.815891] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.816133] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1145.816267] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.816539] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1145.817063] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1145.817063] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.059653] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 1146.059871] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.060158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.060278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.060477] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.060604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.060671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.060848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.060924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.061035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.061181] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.067070] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1146.067310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.566590] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.566740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.566812] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.567064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.567216] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.567317] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.567383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.567539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.567630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.567717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.567863] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.567954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.568037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.568171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.568318] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.568457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.568522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.568666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.568742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.568822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.568907] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.735720] env[62815]: INFO networking_nsxv3.common.synchronization [req-380cc216-f4dc-4416-8052-67b8ff995c83 req-4330eedf-254e-4330-8528-0a0032733cf9 service nova] Enqueued Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_rules [ 1146.735919] env[62815]: INFO networking_nsxv3.common.synchronization [req-380cc216-f4dc-4416-8052-67b8ff995c83 req-4330eedf-254e-4330-8528-0a0032733cf9 service nova] Enqueued Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_members [ 1146.736079] env[62815]: INFO networking_nsxv3.common.synchronization [req-380cc216-f4dc-4416-8052-67b8ff995c83 req-4330eedf-254e-4330-8528-0a0032733cf9 service nova] Enqueued Resource ID: 896ac8e3-b440-490d-900d-d20ecda6fa9f with Priority: HIGHEST for action port [ 1146.736581] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_rules [ 1146.736713] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_members [ 1146.736811] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896ac8e3-b440-490d-900d-d20ecda6fa9f with Priority: HIGHEST for action port [ 1146.737971] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.738125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.738196] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.738457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.738540] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.739551] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.739666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.739765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.739990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.740191] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.740295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.740349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.740499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.740589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1146.740679] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.741429] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-896ac8e3-b440-490d-900d-d20ecda6fa9f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.741537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1146.741616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.741790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1146.741863] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896ac8e3-b440-490d-900d-d20ecda6fa9f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.071381] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8d730a4-9510-494a-a33d-86b82a27d766: rpc.has_security_group_logging(os_id): False [ 1147.088285] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.088499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.088499] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.089341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.089341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.089341] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.089341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.089341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.089654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.089654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.089654] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.089778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.089814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.089929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.090013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.090195] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.090297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.090378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.090524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.090601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.090685] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be updated. [ 1147.146527] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.146736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.146736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.147357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.147357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.159434] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: IN_PROGRESS for 2s [ 1147.244569] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.244755] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.244882] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.246171] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 896ac8e3-b440-490d-900d-d20ecda6fa9f with status ACTIVE [ 1147.246387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.246523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.246580] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.246808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.246923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.247129] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.247230] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.247289] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.247442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.247530] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.247693] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.247820] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.247878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.248037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.248137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.248369] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 896ac8e3-b440-490d-900d-d20ecda6fa9f is going to be updated. [ 1147.277278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1147.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1147.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.277278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896ac8e3-b440-490d-900d-d20ecda6fa9f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.471590] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1147.471590] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 deletion is rescheduled due to dependency. [ 1147.471590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1147.750103] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.253013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.253359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.253359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.253486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.253585] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.253686] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 is going to be created. [ 1148.276567] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.276732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.276732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.276906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.277097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.286021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 in Status: UNINITIALIZED for 2s [ 1148.486221] env[62815]: INFO networking_nsxv3.common.synchronization [req-b900ac2f-29da-499b-9d30-717e5225107d req-a4adec67-b5b0-4d85-a0a5-ff2978286eaf tempest-InstanceActionsNegativeTestJSON-224598625 tempest-InstanceActionsNegativeTestJSON-224598625-project-member] Enqueued Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_members [ 1148.486529] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGHEST for action security_group_members [ 1148.486849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.486971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.487102] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.487350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.487534] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.487658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.487740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.487924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.488047] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.488170] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.990705] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.990851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.990922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.992037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.992037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.992037] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.992037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1148.992037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.992037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1148.992037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1148.992037] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb is going to be updated. [ 1149.019234] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.019418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1149.019467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.019649] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1149.019795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1149.027927] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb in Status: IN_PROGRESS for 2s [ 1149.171643] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 1149.171872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.297511] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 in Status: SUCCESS [ 1150.297787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.298057] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.298272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.298497] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.298621] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.298680] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.298840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.298918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.299017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.299126] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.539340] env[62815]: INFO networking_nsxv3.common.synchronization [req-bc189127-e59f-4e0f-957d-af5b5fadbb7a req-777d4ec9-af0e-4e93-a7bb-84febadca78a tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 1150.539993] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGHEST for action security_group_members [ 1150.540306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.540484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.540484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.540658] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.540811] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.541041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.541041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.541634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.541634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.541634] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.583165] env[62815]: INFO networking_nsxv3.common.synchronization [req-bc189127-e59f-4e0f-957d-af5b5fadbb7a req-777d4ec9-af0e-4e93-a7bb-84febadca78a tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 1128e803-1194-4bac-b14d-17c9727426f6 with Priority: HIGHEST for action port [ 1150.583165] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1128e803-1194-4bac-b14d-17c9727426f6 with Priority: HIGHEST for action port [ 1150.583165] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1128e803-1194-4bac-b14d-17c9727426f6 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.583165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.583165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.583698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.583788] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1128e803-1194-4bac-b14d-17c9727426f6',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.802229] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.802433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.802526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.802770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.802991] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.803148] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.803218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.803369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.803481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.803587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.803769] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.803882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.803963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.804182] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.804374] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.804486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1150.804543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.804749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1150.804826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.804922] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1150.805031] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.038543] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb in Status: SUCCESS [ 1151.038732] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb deletion is rescheduled due to dependency. [ 1151.038795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.045507] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.045720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.045720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.045926] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.046044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.046274] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.046382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.046447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.046609] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.046687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.046774] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be updated. [ 1151.074013] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.074253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.074398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.074742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.074968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.083362] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: IN_PROGRESS for 2s [ 1151.085939] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1128e803-1194-4bac-b14d-17c9727426f6 with status ACTIVE [ 1151.086315] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.086544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.086644] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.086954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.087144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.087416] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.087572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.087661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.087988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.088071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.088402] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.088478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.088551] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.088759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.088873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.089052] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1128e803-1194-4bac-b14d-17c9727426f6 is going to be updated. [ 1151.109360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.109608] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.109712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.109925] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.110081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.110256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1128e803-1194-4bac-b14d-17c9727426f6" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.307870] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41866433-86ed-4e96-8599-ed0cbfc87e32: rpc.has_security_group_logging(os_id): False [ 1151.330020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.330020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.330020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.330020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.330775] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.330775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.330775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.330775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.330775] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.330775] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 is going to be created. [ 1151.390666] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.390666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1151.390666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.390666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1151.390666] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1151.402142] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 in Status: IN_PROGRESS for 2s [ 1153.094590] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8d730a4-9510-494a-a33d-86b82a27d766 in Status: SUCCESS [ 1153.094941] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 deletion is rescheduled due to dependency. [ 1153.094941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.291269] env[62815]: INFO networking_nsxv3.common.synchronization [req-2b40c552-b16e-4a49-a6bc-88f4163ff309 req-b61e8328-5f0a-4066-8faf-569036e7095a tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1153.293015] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1153.293015] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.293015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.293015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.293015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.293015] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.293015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.293015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.293015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.293468] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.293468] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.413066] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 in Status: SUCCESS [ 1153.413320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.669007] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-195 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.669007] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.669007] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.669209] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.669866] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.669866] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.669866] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.670159] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.670544] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.670700] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.670903] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.671105] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.671907] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.672152] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.672335] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.672553] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.690319] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.690541] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.690818] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.691054] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.691429] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.691643] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.691783] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.692184] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.693876] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e72cd137-aaa0-4f0f-9d2a-5d292faaeb90',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.795197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.795441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.795498] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.795752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.796300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.796300] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.796300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.796523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.796605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.796708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.796807] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1153.821393] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.821660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.821660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.823806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.823806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.831487] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1153.926798] env[62815]: INFO networking_nsxv3.common.synchronization [req-8becb18b-4426-4d50-b445-587d0f6575fe req-4ff9d839-0cd5-49fe-b880-c95ca82aa491 tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_members [ 1153.927438] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa with Priority: HIGHEST for action security_group_members [ 1153.927767] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6596d0c-454d-48ce-b640-ed4a68bd5faa taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.927881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.927973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.928238] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.930231] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.930373] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1153.930425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.930995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1153.930995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1153.930995] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6596d0c-454d-48ce-b640-ed4a68bd5faa',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.195634] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.196085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.196161] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.196455] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.196729] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.196972] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 not found, creating... [ 1154.197300] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.197475] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.197599] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.198161] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.198257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.198524] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.198775] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.198922] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.199177] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.199385] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.199583] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 is going to be created. [ 1154.220330] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.220549] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.220679] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.221022] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.221332] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.221576] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.433481] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.433643] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.433717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.433934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.455990] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.456146] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.456313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.457038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.457038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.457038] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.457038] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa is going to be updated. [ 1154.482372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.482948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1154.482948] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.483142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1154.483188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1154.491947] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa in Status: IN_PROGRESS for 2s [ 1155.110359] env[62815]: INFO networking_nsxv3.common.synchronization [req-2b40c552-b16e-4a49-a6bc-88f4163ff309 req-ecb74d9a-0b1f-42e0-9194-0b1736d41656 service nova] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 1155.110560] env[62815]: INFO networking_nsxv3.common.synchronization [req-2b40c552-b16e-4a49-a6bc-88f4163ff309 req-ecb74d9a-0b1f-42e0-9194-0b1736d41656 service nova] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1155.110711] env[62815]: INFO networking_nsxv3.common.synchronization [req-2b40c552-b16e-4a49-a6bc-88f4163ff309 req-ecb74d9a-0b1f-42e0-9194-0b1736d41656 service nova] Enqueued Resource ID: e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 with Priority: HIGHEST for action port [ 1155.110975] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 1155.111145] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1155.111302] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 with Priority: HIGHEST for action port [ 1155.111850] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.111975] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.112444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.112721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.112831] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.113877] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.113984] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.114281] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.114421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.114517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.114717] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.114806] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e72cd137-aaa0-4f0f-9d2a-5d292faaeb90',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.616718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.617150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.617150] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 with status ACTIVE [ 1155.617290] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.617377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.617377] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.617630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.617752] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.617845] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.617961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.618061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.618149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.618223] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.618403] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.618527] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.618591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.618675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.618746] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.618826] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e72cd137-aaa0-4f0f-9d2a-5d292faaeb90 is going to be updated. [ 1155.640590] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.640856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.640856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.641036] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.641098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.641261] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e72cd137-aaa0-4f0f-9d2a-5d292faaeb90" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.843821] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1155.844042] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 deletion is rescheduled due to dependency. [ 1155.844171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.844343] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.844565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.844753] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.844867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1155.844928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.845092] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1155.845178] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1155.845312] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.348423] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.504252] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa in Status: SUCCESS [ 1156.504392] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6596d0c-454d-48ce-b640-ed4a68bd5faa deletion is rescheduled due to dependency. [ 1156.504392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6596d0c-454d-48ce-b640-ed4a68bd5faa" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1156.850700] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.355962] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.355962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.355962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.356132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.356132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.356488] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1157.406818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.406818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1157.406818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.406818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1157.406818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1157.415266] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1158.229827] env[62815]: INFO networking_nsxv3.common.synchronization [req-ab9e0b17-537c-4465-ae8b-6991eca7604e req-fab6f8ce-afdf-4d8e-a229-12c4a8675b60 tempest-ServersNegativeTestMultiTenantJSON-829057627 tempest-ServersNegativeTestMultiTenantJSON-829057627-project-member] Enqueued Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_members [ 1158.230416] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 with Priority: HIGHEST for action security_group_members [ 1158.230724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-41866433-86ed-4e96-8599-ed0cbfc87e32 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.230843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1158.230910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.231271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1158.231436] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.231539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1158.231599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.232063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1158.232063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1158.232063] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41866433-86ed-4e96-8599-ed0cbfc87e32',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.734312] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.734522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1158.734636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.734908] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1158.735029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1158.735248] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.735454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1158.735557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.735735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1158.735819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1158.736017] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 is going to be updated. [ 1158.763919] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.764310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1158.764310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.764583] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1158.764760] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1158.772679] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 in Status: IN_PROGRESS for 2s [ 1159.426021] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1159.427199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1159.427199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.427199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1159.427199] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.427199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1159.427199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.427199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1159.427804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1159.427865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1159.427962] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.930354] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.433778] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd01ddbc-d1e1-4701-8791-8347e2ae4ba7: rpc.has_security_group_logging(os_id): False [ 1160.451419] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.451555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1160.451799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.451881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1160.451920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1160.452646] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.452646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1160.452646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.452646] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1160.452906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1160.452906] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1160.508617] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.508765] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1160.508859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.509153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1160.509300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1160.519408] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1160.781193] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 in Status: SUCCESS [ 1160.781370] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41866433-86ed-4e96-8599-ed0cbfc87e32 deletion is rescheduled due to dependency. [ 1160.781519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41866433-86ed-4e96-8599-ed0cbfc87e32" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1161.589520] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.589881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1161.589881] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.590181] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1161.590601] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.590787] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1161.590961] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.593090] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1161.593090] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1161.593279] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.593450] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.593579] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.593697] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.593818] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.593932] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.594101] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.615493] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.616491] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.616491] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.616491] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1161.616491] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-e2e262ac-6977-43f6-9dc5-f7d7363a2023 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.617037] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1161.617037] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.617037] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1161.617173] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e262ac-6977-43f6-9dc5-f7d7363a2023',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.120625] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.120922] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.121154] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.121449] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.121645] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.121894] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.122092] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.122197] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.122428] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.122567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.122871] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.123114] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.123245] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.123471] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.123613] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.123764] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 is going to be updated. [ 1162.144680] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.144941] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.145129] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.145422] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.145834] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.146179] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.530732] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1162.530732] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.921025] env[62815]: INFO networking_nsxv3.common.synchronization [req-b9fc882d-fae7-410c-903a-f570a912fab9 req-ef4e1ce4-e438-47f1-a85d-01465bf165b4 service nova] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1162.921489] env[62815]: INFO networking_nsxv3.common.synchronization [req-b9fc882d-fae7-410c-903a-f570a912fab9 req-ef4e1ce4-e438-47f1-a85d-01465bf165b4 service nova] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1162.921489] env[62815]: INFO networking_nsxv3.common.synchronization [req-b9fc882d-fae7-410c-903a-f570a912fab9 req-ef4e1ce4-e438-47f1-a85d-01465bf165b4 service nova] Enqueued Resource ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 with Priority: HIGHEST for action port [ 1162.921875] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_rules [ 1162.922017] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1162.922158] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 with Priority: HIGHEST for action port [ 1162.923667] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.923667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.923667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.923667] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.923667] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.926093] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.926203] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.926245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.926425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.926587] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.926675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.926723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.926920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.927031] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1162.927132] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.928142] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2e262ac-6977-43f6-9dc5-f7d7363a2023 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.928142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1162.928142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.928259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1162.928259] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e262ac-6977-43f6-9dc5-f7d7363a2023',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.430118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.430284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.434022] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.434022] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2e262ac-6977-43f6-9dc5-f7d7363a2023 with status ACTIVE [ 1163.434022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.434022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.434022] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.434022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.434659] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.434659] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2e262ac-6977-43f6-9dc5-f7d7363a2023 is going to be updated. [ 1163.452429] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.452562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1163.452604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.452814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1163.452920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.453132] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2e262ac-6977-43f6-9dc5-f7d7363a2023" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1163.936905] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.444756] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.445035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.445159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.445517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.445799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.445881] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 is going to be updated. [ 1164.481118] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.481118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1164.481118] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.481462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1164.481816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1164.491434] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: IN_PROGRESS for 2s [ 1165.172648] env[62815]: INFO networking_nsxv3.common.synchronization [req-02f091bb-5a87-4238-b010-a27cc4a6f9d7 req-4f39d4d4-8dbb-46b4-87f1-88d83724171b tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 1165.173163] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 1165.173491] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.174197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.174197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.174197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.177351] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.177524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1165.177572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.177753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1165.177961] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1165.178088] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.680496] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.182417] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.502627] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: SUCCESS [ 1166.502940] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.503166] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.503491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.503634] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.503757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.503845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.504016] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.504108] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.504215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.504421] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.685145] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.686205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.686205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.686205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.686205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.686205] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be updated. [ 1166.733476] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.733675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1166.733722] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.733931] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1166.734157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1166.748885] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: IN_PROGRESS for 2s [ 1167.007510] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.509849] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 850db9bd-9d54-4da0-9136-8492981ff313: rpc.has_security_group_logging(os_id): False [ 1167.534330] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.534546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.534546] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.534849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.556159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.556571] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.556705] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.556803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.556995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.557095] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.559014] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 is going to be updated. [ 1167.620078] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.620263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1167.620341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.620559] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1167.620735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1167.634377] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: IN_PROGRESS for 2s [ 1168.758922] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 1168.759263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1169.646665] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: SUCCESS [ 1169.646892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1170.174205] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1170.174649] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1172.049252] env[62815]: INFO networking_nsxv3.common.synchronization [req-fc24448b-cd58-403e-8aac-67773cd1ba53 req-556d5490-edef-4e73-b204-1a8dc7681f5e tempest-ServerRescueNegativeTestJSON-818433205 tempest-ServerRescueNegativeTestJSON-818433205-project-member] Enqueued Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 1172.053021] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd with Priority: HIGHEST for action security_group_members [ 1172.053021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.053021] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.053021] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.053021] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.141359] env[62815]: INFO networking_nsxv3.common.synchronization [req-b4238988-a8af-4555-8c5c-2e53cfdd91d5 req-8aac94d0-e617-4711-b03b-f47a0bb7c4ad tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1172.142097] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1172.142417] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.143028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.143028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.143028] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.143028] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.143283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.143283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.143354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.143387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.143484] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.556319] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.556572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.556572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.556816] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.578861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.579282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.579478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.579604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.579932] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.580114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.580282] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd is going to be updated. [ 1172.604152] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.604305] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.604375] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.604663] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.604818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.612458] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: IN_PROGRESS for 2s [ 1172.646210] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.646692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.646692] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.646994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.647130] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.647388] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.647526] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.647626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.647890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.647995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.648213] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1172.675061] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.675152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1172.675193] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.675397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1172.675537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1172.683167] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1174.621890] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd in Status: SUCCESS [ 1174.622306] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd deletion is rescheduled due to dependency. [ 1174.622306] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1174.690713] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1174.690969] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1174.691105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.170168] env[62815]: INFO networking_nsxv3.common.synchronization [req-18d07856-5f85-4147-88b9-8af084420cbf req-1779de3e-6bd3-496f-8be3-e5cb6c07f058 tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1175.170771] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1175.171141] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.171280] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.171371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.171578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.171757] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.171860] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.171927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.172296] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.172412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.172510] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.524767] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-404 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.524887] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.525037] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.525386] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.525671] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.525839] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.525972] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.526211] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.526437] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.526785] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.526785] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.526911] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.527020] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.527136] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.527248] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.527404] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.546086] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.546272] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.546432] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.546609] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-404" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1175.546947] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.547157] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1175.547284] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.547644] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1175.547792] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d08959fc-3b6f-4881-9e9d-3ed612cbf89f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.675059] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.049823] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.050069] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.050206] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.050510] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.050669] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.050829] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port d08959fc-3b6f-4881-9e9d-3ed612cbf89f not found, creating... [ 1176.051105] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.051298] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.051427] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.051650] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.051794] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.052091] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.052257] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.052380] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.052597] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.052736] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.052877] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: d08959fc-3b6f-4881-9e9d-3ed612cbf89f is going to be created. [ 1176.072614] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.072847] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.072979] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.073399] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.073551] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.073781] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.176998] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.679308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.679612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.679612] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.679740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.680842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.680842] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be updated. [ 1176.707735] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.707956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.707956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.708186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.708337] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.719982] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: IN_PROGRESS for 2s [ 1176.989039] env[62815]: INFO networking_nsxv3.common.synchronization [req-1f6df80f-a568-4f29-9832-71aa8cbbf7df req-21efb147-c6b3-471e-9d66-cea80f06cd60 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_members [ 1176.989571] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGHEST for action security_group_members [ 1176.989871] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.989995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.990087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.990290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.990438] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.990535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1176.990596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.990739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1176.990927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1176.990927] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.497720] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.497929] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.498045] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.498332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.498471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.498931] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.499137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.499487] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.499768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.499918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.500198] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 is going to be updated. [ 1177.532483] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.532708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.532799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.533109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.533360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1177.542068] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 in Status: IN_PROGRESS for 2s [ 1177.610488] env[62815]: INFO networking_nsxv3.common.synchronization [req-18d07856-5f85-4147-88b9-8af084420cbf req-bedd9717-2aa1-4305-8075-033ac23641ad service nova] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 1177.610703] env[62815]: INFO networking_nsxv3.common.synchronization [req-18d07856-5f85-4147-88b9-8af084420cbf req-bedd9717-2aa1-4305-8075-033ac23641ad service nova] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1177.610879] env[62815]: INFO networking_nsxv3.common.synchronization [req-18d07856-5f85-4147-88b9-8af084420cbf req-bedd9717-2aa1-4305-8075-033ac23641ad service nova] Enqueued Resource ID: d08959fc-3b6f-4881-9e9d-3ed612cbf89f with Priority: HIGHEST for action port [ 1177.611429] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_rules [ 1177.611817] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1177.611817] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d08959fc-3b6f-4881-9e9d-3ed612cbf89f with Priority: HIGHEST for action port [ 1177.612120] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.612274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.612363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.612589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.614654] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.614654] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.614654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.614654] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.614654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1177.614654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.614654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1177.615238] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d08959fc-3b6f-4881-9e9d-3ed612cbf89f',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.117175] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.117464] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.117673] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d08959fc-3b6f-4881-9e9d-3ed612cbf89f with status ACTIVE [ 1178.117673] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.117771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.117856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.118074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.118254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.118426] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.118622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.118622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.118759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.118856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.119455] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.119455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.119455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.119455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.119455] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.119672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d08959fc-3b6f-4881-9e9d-3ed612cbf89f is going to be updated. [ 1178.139105] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.139323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.139382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.139593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.139989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.139989] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d08959fc-3b6f-4881-9e9d-3ed612cbf89f" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.728998] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 1178.729239] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.729401] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.729622] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.729828] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.729943] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1178.730013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.730195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1178.730281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1178.730378] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.158564] env[62815]: INFO networking_nsxv3.common.synchronization [req-ebb93cbd-275f-42e3-96d3-cd9989ceaeb0 req-26629fe0-1603-42e2-8ff8-cb6e969c6dde tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1179.159174] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1179.159438] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.160018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.160018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.160018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.160018] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.160276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.160276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.160415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.160516] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.160620] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.232425] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.550716] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 in Status: SUCCESS [ 1179.550892] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 deletion is rescheduled due to dependency. [ 1179.551096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.558726] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.559033] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.559185] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.559461] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.559734] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.559897] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.560697] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.561028] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.561196] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.561420] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.561544] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.561661] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.561774] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.561892] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.562007] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.562155] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.579059] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.579246] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.579392] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.579571] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.580732] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-4cf1c384-b533-4773-a66e-74581ba697f9 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.580732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.580732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.580732] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.580732] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf1c384-b533-4773-a66e-74581ba697f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.666381] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.666381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.666381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.666381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.666381] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.666801] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.666801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.666801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.666801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.667011] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.667011] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1179.692098] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.692098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1179.692098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.692098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1179.692098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1179.699957] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1179.734876] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.082762] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.083042] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.083256] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.083590] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.083798] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.083978] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 4cf1c384-b533-4773-a66e-74581ba697f9 not found, creating... [ 1180.084281] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.084454] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.084609] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.084864] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.085029] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.085342] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.085582] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.085752] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.085999] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.086209] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.086402] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 4cf1c384-b533-4773-a66e-74581ba697f9 is going to be created. [ 1180.107620] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.107807] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.107935] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.108200] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.108428] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.108645] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.237131] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.237556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.237556] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.237639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.237675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.237773] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be updated. [ 1180.268597] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.268825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1180.268954] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.269260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1180.269437] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1180.276334] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: IN_PROGRESS for 2s [ 1181.061583] env[62815]: INFO networking_nsxv3.common.synchronization [req-ebb93cbd-275f-42e3-96d3-cd9989ceaeb0 req-8177574a-6423-4f81-8e87-e322266e6846 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1181.061583] env[62815]: INFO networking_nsxv3.common.synchronization [req-ebb93cbd-275f-42e3-96d3-cd9989ceaeb0 req-8177574a-6423-4f81-8e87-e322266e6846 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1181.061583] env[62815]: INFO networking_nsxv3.common.synchronization [req-ebb93cbd-275f-42e3-96d3-cd9989ceaeb0 req-8177574a-6423-4f81-8e87-e322266e6846 service nova] Enqueued Resource ID: 4cf1c384-b533-4773-a66e-74581ba697f9 with Priority: HIGHEST for action port [ 1181.061583] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1181.061583] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1181.061583] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf1c384-b533-4773-a66e-74581ba697f9 with Priority: HIGHEST for action port [ 1181.061832] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.062227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.062393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.062703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.062901] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.068863] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.068863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.068863] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf1c384-b533-4773-a66e-74581ba697f9 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.068863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.068863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.068863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.068863] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf1c384-b533-4773-a66e-74581ba697f9',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.480109] env[62815]: INFO networking_nsxv3.common.synchronization [None req-03d3c10c-5fab-401d-94af-ed86294bdd60 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_rules [ 1181.481251] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_rules [ 1181.481251] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.481251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.481251] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.481472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.481594] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.562842] env[62815]: INFO networking_nsxv3.common.synchronization [None req-3211f803-eb15-4043-a595-1ace0b7a3450 tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_rules [ 1181.563442] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_rules [ 1181.563770] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.563877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.566744] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.566881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.571470] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cf1c384-b533-4773-a66e-74581ba697f9 with status ACTIVE [ 1181.571720] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.571808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.571845] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.572064] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.572150] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.572325] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.572423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.572491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.572632] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.572706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.572885] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.572979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.573044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.573202] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.573274] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.573361] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cf1c384-b533-4773-a66e-74581ba697f9 is going to be updated. [ 1181.591572] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.591739] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.591824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.592103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.592387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.592473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf1c384-b533-4773-a66e-74581ba697f9" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.712224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1181.712224] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.712224] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1181.712224] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1181.712224] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.000961] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.001217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.001272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.001506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.001594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.001696] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b already deleted. [ 1182.001795] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.001962] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.002144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.002223] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.215547] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.285499] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 1182.285799] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.286044] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.286370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.286631] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.286787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.286879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.287112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.287226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.287349] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.287475] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.529920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.530380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1182.530380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.530525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1182.530614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.530739] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b already deleted. [ 1182.530829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1182.718327] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.789600] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.220733] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.220897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.221046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.221248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.221347] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.221452] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1183.250348] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.250484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.250624] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.250750] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.250890] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.258438] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1183.291971] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4881bfba-b46e-4d29-a2f7-9a11e08570b3: rpc.has_security_group_logging(os_id): False [ 1183.311020] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.311195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.311241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.311492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.327687] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.328007] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.328134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.328199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.328454] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.328552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.328645] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be updated. [ 1183.385518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.385518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1183.385518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.385892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1183.385892] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1183.397282] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: IN_PROGRESS for 2s [ 1185.268351] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1185.268785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.268785] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.268874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.269043] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.269164] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.269225] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.269383] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.269479] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.269533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.269666] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.408733] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 1185.408973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.772158] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.772448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.772448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.772610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.772782] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.772914] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.772963] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.773110] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.773235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.773339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.773486] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.773578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.773630] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.773772] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.773903] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.773992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1185.774062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.774205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1185.774276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.774355] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1185.774441] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.276995] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933a2727-d7f2-415f-9a38-6d105996267c: rpc.has_security_group_logging(os_id): False [ 1186.293702] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.293910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.293910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.294158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.294315] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.294513] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.294614] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.294678] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.294827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.294903] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.295161] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.295242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.295279] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.295392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.295481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.295724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.295821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.295882] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.296034] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.296112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.296197] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1186.350985] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.351211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1186.351330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.351579] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1186.351751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1186.362693] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1186.564501] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1186.564691] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1187.481737] env[62815]: INFO networking_nsxv3.common.synchronization [req-08d2728f-dd57-4366-bd1f-753a463f101a req-db3f88a3-d570-435a-8c54-4f3a81c76a8a tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_members [ 1187.482352] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_members [ 1187.482677] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.482798] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.482866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.483115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.483407] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.483533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.483602] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.483771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.483861] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.483955] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.792233] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.792445] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.792579] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.792859] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.793138] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.793459] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.793620] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.793859] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.794140] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.794287] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.794426] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.794614] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.794809] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.795017] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.795166] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.795320] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.813416] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.813546] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.814782] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.814782] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-943" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.814782] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-b5ce0c58-0c73-4f6c-955a-e3630554a031 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.814782] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.814782] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.814782] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.815120] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ce0c58-0c73-4f6c-955a-e3630554a031',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.987140] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.987411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.987411] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.987685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.987801] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.988014] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.988142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1187.988248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.988476] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1187.988575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1187.988717] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b already deleted. [ 1187.988827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.318491] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.318755] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.318855] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.319188] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.319351] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.319515] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port b5ce0c58-0c73-4f6c-955a-e3630554a031 not found, creating... [ 1188.319786] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.319949] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.320085] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.320333] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.320497] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.320787] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.320949] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.321120] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.321334] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.321478] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.321622] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: b5ce0c58-0c73-4f6c-955a-e3630554a031 is going to be created. [ 1188.339755] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.339950] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1188.340087] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.340354] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1188.340583] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.340805] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1188.376761] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1188.377032] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.062670] env[62815]: INFO networking_nsxv3.common.synchronization [req-08d2728f-dd57-4366-bd1f-753a463f101a req-b3935433-2b3a-420e-bb44-891f9f9c404e service nova] Enqueued Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_rules [ 1189.062870] env[62815]: INFO networking_nsxv3.common.synchronization [req-08d2728f-dd57-4366-bd1f-753a463f101a req-b3935433-2b3a-420e-bb44-891f9f9c404e service nova] Enqueued Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_members [ 1189.063068] env[62815]: INFO networking_nsxv3.common.synchronization [req-08d2728f-dd57-4366-bd1f-753a463f101a req-b3935433-2b3a-420e-bb44-891f9f9c404e service nova] Enqueued Resource ID: b5ce0c58-0c73-4f6c-955a-e3630554a031 with Priority: HIGHEST for action port [ 1189.063325] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_rules [ 1189.063461] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_members [ 1189.063628] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ce0c58-0c73-4f6c-955a-e3630554a031 with Priority: HIGHEST for action port [ 1189.064126] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.064287] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.064360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.064572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.064712] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.065521] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.065639] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.065710] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.065872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.066027] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.066124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.066186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.066327] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.066410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.066497] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.067795] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ce0c58-0c73-4f6c-955a-e3630554a031 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.067901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.067972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.068144] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.068220] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ce0c58-0c73-4f6c-955a-e3630554a031',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.570258] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.571411] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.571545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.574513] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5ce0c58-0c73-4f6c-955a-e3630554a031 with status ACTIVE [ 1189.574718] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.574881] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.574959] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.575133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.575222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.575394] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.575494] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.575618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.575786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.575867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.576059] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.576158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.576220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.576368] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.576439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.576525] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5ce0c58-0c73-4f6c-955a-e3630554a031 is going to be updated. [ 1189.595066] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.595234] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1189.595281] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.595442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1189.595645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1189.595803] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ce0c58-0c73-4f6c-955a-e3630554a031" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.072205] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.409066] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.409302] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.409456] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.409770] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.410079] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.410255] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.410400] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.410636] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.410794] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.411077] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.411311] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.411453] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.411584] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.411715] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.411837] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.411985] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.429934] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.430198] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.430300] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.430560] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-361" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.430864] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-4da0739e-5af8-4beb-94a9-9f098b81bf02 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.431142] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.431258] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.431567] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.431750] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da0739e-5af8-4beb-94a9-9f098b81bf02',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.575095] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.575263] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.575338] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.575557] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.575651] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.575760] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b is going to be created. [ 1190.599247] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.599423] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.599474] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.599656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.599813] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.608727] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b in Status: UNINITIALIZED for 2s [ 1190.934685] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.934929] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.935096] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.935398] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.935577] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.935878] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.936055] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.936181] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.936458] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.936553] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.936863] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.937041] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.937168] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.937382] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.937525] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.937666] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 is going to be updated. [ 1190.956670] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.956886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1190.957028] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.957323] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1190.957562] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1190.957795] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.011375] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f7d7487-562a-46fd-a5f9-c9e775c92332 req-6b1d344e-502b-40b1-8ea2-2b01f6ba942b service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 1192.011654] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f7d7487-562a-46fd-a5f9-c9e775c92332 req-6b1d344e-502b-40b1-8ea2-2b01f6ba942b service nova] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1192.011782] env[62815]: INFO networking_nsxv3.common.synchronization [req-5f7d7487-562a-46fd-a5f9-c9e775c92332 req-6b1d344e-502b-40b1-8ea2-2b01f6ba942b service nova] Enqueued Resource ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 with Priority: HIGHEST for action port [ 1192.012317] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_rules [ 1192.012476] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1192.012593] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 with Priority: HIGHEST for action port [ 1192.013164] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.013409] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.013985] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.014452] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.015035] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.017209] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.017572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.017724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.018712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.020663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.020793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.020865] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.021188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.021188] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.021302] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.022088] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-4da0739e-5af8-4beb-94a9-9f098b81bf02 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.022211] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.022248] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.022406] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.022486] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da0739e-5af8-4beb-94a9-9f098b81bf02',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.523951] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.524143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.524210] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.525142] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4da0739e-5af8-4beb-94a9-9f098b81bf02 with status ACTIVE [ 1192.525319] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.525428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.525491] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.525742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.525831] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.526015] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.526105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.527024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.527024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.527024] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4da0739e-5af8-4beb-94a9-9f098b81bf02 is going to be updated. [ 1192.549244] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.549244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.549244] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.549515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.549515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.549606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4da0739e-5af8-4beb-94a9-9f098b81bf02" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.623960] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b in Status: SUCCESS [ 1192.624254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.624404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.624617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.624803] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.624918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1192.624983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.625216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1192.625216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.625308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1192.625401] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.029434] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.127764] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.531764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.531920] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.531992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.532243] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.532340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.532474] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1193.558835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.558994] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.559065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.559270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.559432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.567363] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1193.629867] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a1fff72-edb0-4132-b12f-f8e30ff1c78b: rpc.has_security_group_logging(os_id): False [ 1193.646936] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.647169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.647247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.647475] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.647572] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.647817] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.647916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.647977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.648136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.648209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.648296] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b is going to be created. [ 1193.704768] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.705242] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1193.705290] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.705806] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1193.706015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1193.713605] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b in Status: IN_PROGRESS for 2s [ 1195.520190] env[62815]: INFO networking_nsxv3.common.synchronization [req-2f886497-b25c-45ee-8d02-5ccb6514f63f req-e97276b2-5444-4c5e-bf4e-f2f68b327fe8 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1195.520190] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1195.520572] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.520817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.520968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.521250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.521508] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.521730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.521934] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.522285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.522492] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.522676] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.578172] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.583362] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.583362] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1195.583362] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.724064] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b in Status: SUCCESS [ 1195.724301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.024876] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.025063] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.025140] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.025356] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.025456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.025690] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.025787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.025855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.026023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.026105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.026224] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1196.052805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.053018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.053018] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.053213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.053548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.061432] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1196.086544] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.588927] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2840bf9-b592-4644-bcf1-bd4ca72a79e5: rpc.has_security_group_logging(os_id): False [ 1196.606030] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.606260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.606380] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.606669] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.606851] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.607195] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.607360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.607485] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.607735] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.607844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.607942] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1196.663497] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.663699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1196.663699] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.663956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1196.664146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1196.674290] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1198.072288] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1198.072288] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1198.072657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1198.685720] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1198.685720] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1200.520775] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.521288] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1204.081532] env[62815]: INFO networking_nsxv3.common.synchronization [req-f63e8edd-a7a9-4570-9404-b4981c84b805 req-9cb191eb-2ce0-4669-8290-fdd79dd3b515 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1204.082035] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1204.082392] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.082524] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.082586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.082792] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.082945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.086153] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.086292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.086511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.086656] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.086788] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.423982] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.424282] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.424461] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.424771] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.425081] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.425402] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.425486] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.425722] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.425878] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.426115] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.426238] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.426349] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.426501] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.426650] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.426765] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.426905] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.450163] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.450356] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1204.450867] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.450867] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.451053] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.451193] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.451337] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.451688] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.451840] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7ec6aed-2b8c-4688-b55f-5d7912f3ab92',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.589617] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.589870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.589870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.590069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.590165] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.590416] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.590571] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.590698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.590866] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.590946] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.591044] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1204.619177] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.619412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.619412] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.619599] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.619744] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.630055] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1204.953910] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.954046] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.954886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.954886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.954886] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.954886] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 not found, creating... [ 1204.955130] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.955315] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.955429] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.955963] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.955963] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.956072] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.956185] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.956293] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.956512] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.956654] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.956798] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 is going to be created. [ 1204.977148] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.977416] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1204.977521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.977863] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1204.978143] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1204.978392] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1205.655970] env[62815]: INFO networking_nsxv3.common.synchronization [req-f63e8edd-a7a9-4570-9404-b4981c84b805 req-d8474259-c73b-46a2-8c4b-880469491f93 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1205.656278] env[62815]: INFO networking_nsxv3.common.synchronization [req-f63e8edd-a7a9-4570-9404-b4981c84b805 req-d8474259-c73b-46a2-8c4b-880469491f93 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1205.656278] env[62815]: INFO networking_nsxv3.common.synchronization [req-f63e8edd-a7a9-4570-9404-b4981c84b805 req-d8474259-c73b-46a2-8c4b-880469491f93 service nova] Enqueued Resource ID: c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 with Priority: HIGHEST for action port [ 1205.656526] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1205.656664] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1205.656815] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 with Priority: HIGHEST for action port [ 1205.657469] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.657662] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.657759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.658026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.658138] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.659523] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.659523] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.660254] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.660254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1205.660254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.660254] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1205.660254] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7ec6aed-2b8c-4688-b55f-5d7912f3ab92',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.162077] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.162323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.164606] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 with status ACTIVE [ 1206.166753] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.166753] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.166753] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.166753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.166753] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7ec6aed-2b8c-4688-b55f-5d7912f3ab92 is going to be updated. [ 1206.188856] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.189055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.189105] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.189294] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.189436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.189603] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7ec6aed-2b8c-4688-b55f-5d7912f3ab92" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.639139] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1206.639316] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1206.639436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.639591] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.639810] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.639986] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.640114] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1206.640179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.640335] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1206.640414] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1206.640508] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.142694] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.648787] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.151958] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.152255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.152255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.152415] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.153481] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.153481] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1208.178901] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.179073] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1208.179136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.179308] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1208.179451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1208.188622] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1210.200646] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1210.201026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.201026] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.201227] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.201454] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.201576] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.201635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.201793] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.201885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.201983] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.202111] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.360478] env[62815]: INFO networking_nsxv3.common.synchronization [req-8bf31715-0f6c-46c0-8efe-73f1339d7839 req-e2f58260-67e0-43a7-8198-96a0c0d97c85 tempest-ServerActionsTestOtherB-808029565 tempest-ServerActionsTestOtherB-808029565-project-member] Enqueued Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1210.361075] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 with Priority: HIGHEST for action security_group_members [ 1210.361488] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.361897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.361897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.362087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.362271] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.362271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.362421] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.362507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.363156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.363156] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2840bf9-b592-4644-bcf1-bd4ca72a79e5',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.704708] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.704904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.704999] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.705258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.705459] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.705595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.705706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.705856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.705972] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.706109] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.706262] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.706357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.706457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.706617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.706828] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.706916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.706916] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.707070] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.707169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.707256] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.707346] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.864835] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.865111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.865111] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.865302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.865397] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.865593] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.865691] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.865745] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.865902] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.865980] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.866093] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 is going to be updated. [ 1210.891282] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.891504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1210.891504] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.891671] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1210.891819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1210.900346] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: IN_PROGRESS for 2s [ 1211.210417] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933a2727-d7f2-415f-9a38-6d105996267c: rpc.has_security_group_logging(os_id): False [ 1211.227875] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.228192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.228192] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.228371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.228441] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.229024] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.229024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.229024] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.229472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.229562] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.229771] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.229869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.229936] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.230096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.230174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.230377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.230543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.230605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.230749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.230825] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.230912] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1211.285879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.286082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1211.286174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.286323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1211.286473] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1211.302445] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1212.910490] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 in Status: SUCCESS [ 1212.910927] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2840bf9-b592-4644-bcf1-bd4ca72a79e5 deletion is rescheduled due to dependency. [ 1212.910927] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2840bf9-b592-4644-bcf1-bd4ca72a79e5" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1213.320298] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1213.320604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1215.362878] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.362878] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1219.081844] env[62815]: INFO networking_nsxv3.common.synchronization [req-8ac16ffa-9af3-445d-b108-7e068f061d1c req-33bd2112-d717-42b6-8e5e-1c91f1db3d5f tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1219.082430] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1219.082744] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.082867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.082944] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.083152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.083308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.083450] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.083521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.083887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.083887] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.083887] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.591273] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.591273] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.591273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.591273] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1219.619581] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.619742] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1219.619824] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.619991] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1219.620146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1219.630153] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1221.641244] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 4s [ 1222.129045] env[62815]: INFO networking_nsxv3.common.synchronization [req-19a16835-167b-48d6-8e13-cd8aea0eada3 req-1bb271d6-5db7-4cc7-90fe-385af3df1e21 tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1222.131519] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGHEST for action security_group_members [ 1222.131839] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.132066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.132066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.132255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.132642] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.132642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.132642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.132808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.132808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.132870] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.634698] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.634909] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.634950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.635212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.635314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.635540] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.635665] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.635778] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.635967] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.636075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.636176] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 is going to be updated. [ 1222.660920] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.661276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1222.661276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.661276] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1222.661483] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1222.669089] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: IN_PROGRESS for 2s [ 1223.651844] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1223.652148] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1223.652321] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1224.678697] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850db9bd-9d54-4da0-9136-8492981ff313 in Status: SUCCESS [ 1224.678697] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 deletion is rescheduled due to dependency. [ 1224.678697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1227.132272] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.132637] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1228.738649] env[62815]: INFO networking_nsxv3.common.synchronization [None req-e5bab7b6-4a09-4ea4-a622-40676c5c0c8e tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1228.738649] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1228.738937] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.739000] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1228.739058] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.739292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1228.739371] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.804212] env[62815]: INFO networking_nsxv3.common.synchronization [None req-82275bd9-4fef-41eb-8344-3032b6d0427c tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1228.804852] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1228.805205] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.805313] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.260232] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.260390] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.260432] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.260648] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.260741] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.260837] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d already deleted. [ 1229.260921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.261087] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.261451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.261451] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.780210] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.780618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1229.780618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.780618] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1229.780766] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1229.780766] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d already deleted. [ 1229.780843] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.496937] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c6a791-8f7d-454b-b89a-5da1821ffc77 req-26ddb220-69d8-4a98-aed8-0df01fbc5ef3 tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1230.497520] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1230.497849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.498123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.498123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.498253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.498372] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.498465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.498529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.498660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.498749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.498838] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.830663] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.830958] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.830997] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.831355] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.831646] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.831868] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.831933] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.832166] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.832312] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.832556] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.832686] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.832820] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.832946] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.833083] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.833211] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.833358] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.850796] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.850949] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.851108] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.851275] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-228" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1230.851568] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-ad0e336b-7622-45b2-aa13-97662c287b15 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.851737] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1230.851860] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.852181] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1230.852328] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad0e336b-7622-45b2-aa13-97662c287b15',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.000645] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.000901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.000901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.001084] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.001179] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.001377] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.001514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.001582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.001704] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.001781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.001869] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1231.027871] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.028022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.028022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.028169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.028336] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.037338] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1231.355086] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.355342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.355342] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.355611] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.355765] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.355955] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port ad0e336b-7622-45b2-aa13-97662c287b15 not found, creating... [ 1231.356246] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.356409] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.356533] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.356761] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.356909] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.357216] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.357379] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.357501] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.357716] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.357856] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.357999] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: ad0e336b-7622-45b2-aa13-97662c287b15 is going to be created. [ 1231.377630] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.377877] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1231.377968] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.378284] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1231.378521] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.378750] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1231.475112] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1231.475280] env[62815]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-741e289a-cf32-48e0-89b0-7d7bd7a9a7b7 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1232.054159] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c6a791-8f7d-454b-b89a-5da1821ffc77 req-4cdc520c-3604-4963-9b5f-337e724b97e9 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1232.054393] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c6a791-8f7d-454b-b89a-5da1821ffc77 req-4cdc520c-3604-4963-9b5f-337e724b97e9 service nova] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1232.054507] env[62815]: INFO networking_nsxv3.common.synchronization [req-f1c6a791-8f7d-454b-b89a-5da1821ffc77 req-4cdc520c-3604-4963-9b5f-337e724b97e9 service nova] Enqueued Resource ID: ad0e336b-7622-45b2-aa13-97662c287b15 with Priority: HIGHEST for action port [ 1232.054760] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_rules [ 1232.054875] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1232.054972] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad0e336b-7622-45b2-aa13-97662c287b15 with Priority: HIGHEST for action port [ 1232.055506] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.055634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.055714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.055941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.056060] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.057219] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.057286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.057518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad0e336b-7622-45b2-aa13-97662c287b15 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.057586] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.057629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.057786] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.057859] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad0e336b-7622-45b2-aa13-97662c287b15',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.560561] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.560776] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.562107] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad0e336b-7622-45b2-aa13-97662c287b15 with status ACTIVE [ 1232.562390] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.562853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.562853] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.563037] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.563200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.563468] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.563708] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.563790] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.564023] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.564156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.564433] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.564598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.564712] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.564941] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.565139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.565287] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad0e336b-7622-45b2-aa13-97662c287b15 is going to be updated. [ 1232.585883] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.586088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1232.586088] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.586285] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1232.586416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1232.586574] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad0e336b-7622-45b2-aa13-97662c287b15" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.050562] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1233.050752] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1233.050873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.051124] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.051253] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.051554] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.051554] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1233.051645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.051728] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1233.051808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1233.051901] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.554813] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.057402] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.113341] env[62815]: INFO networking_nsxv3.common.synchronization [req-56dd53b8-b19b-4503-b2e7-70f00e5d3841 req-7580aacc-fd77-4431-a980-017dcad36e13 tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1234.114369] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1234.115545] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.115545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.115545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.115545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.115740] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.115740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.115740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.116971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.116971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.116971] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.429924] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.430137] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.431026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.431026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.431026] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.431026] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.431255] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.431290] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.431486] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.431717] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.431840] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.432142] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.432142] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.432297] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.432297] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.432413] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.449127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.449314] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.449463] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.449638] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.449940] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-249b8ea2-8825-4ada-891c-72db3ea03581 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.450136] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.450291] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.450572] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.450719] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b8ea2-8825-4ada-891c-72db3ea03581',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.561394] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.561740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.561740] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.561867] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.561958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.562075] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1234.586311] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.586478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.586534] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.586719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.586863] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.594832] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1234.619461] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.619604] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.619684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.619885] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.619978] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.620188] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.620286] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.620340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.620490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.620567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.620651] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d already deleted. [ 1234.620736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.953069] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.953313] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.953448] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.953829] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.953985] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.954164] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 249b8ea2-8825-4ada-891c-72db3ea03581 not found, creating... [ 1234.954436] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.954658] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.954811] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.955048] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.955195] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.955484] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.955646] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.955768] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.955982] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.956133] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.956276] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 249b8ea2-8825-4ada-891c-72db3ea03581 is going to be created. [ 1234.974259] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.974450] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1234.974602] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.974858] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1234.975102] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1234.975325] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.667501] env[62815]: INFO networking_nsxv3.common.synchronization [req-56dd53b8-b19b-4503-b2e7-70f00e5d3841 req-da24228e-5d8d-4bc4-82f5-9c2c2fdc8dbe service nova] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1235.667828] env[62815]: INFO networking_nsxv3.common.synchronization [req-56dd53b8-b19b-4503-b2e7-70f00e5d3841 req-da24228e-5d8d-4bc4-82f5-9c2c2fdc8dbe service nova] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1235.667902] env[62815]: INFO networking_nsxv3.common.synchronization [req-56dd53b8-b19b-4503-b2e7-70f00e5d3841 req-da24228e-5d8d-4bc4-82f5-9c2c2fdc8dbe service nova] Enqueued Resource ID: 249b8ea2-8825-4ada-891c-72db3ea03581 with Priority: HIGHEST for action port [ 1235.668156] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1235.668286] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1235.668513] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b8ea2-8825-4ada-891c-72db3ea03581 with Priority: HIGHEST for action port [ 1235.668923] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.669392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.669541] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.669788] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.669923] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.671196] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.671631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.671631] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.671879] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.672089] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.672268] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.672470] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.672684] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.672821] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1235.672956] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.676197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-249b8ea2-8825-4ada-891c-72db3ea03581 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.676197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1235.676197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.676197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1235.676197] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b8ea2-8825-4ada-891c-72db3ea03581',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.176254] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.177381] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.177500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.177847] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 249b8ea2-8825-4ada-891c-72db3ea03581 with status ACTIVE [ 1236.178036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.178149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.178215] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.178427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.178517] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.178684] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.178780] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.178842] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.178992] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.179094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.179274] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.179400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.179439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.179558] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.179634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.179713] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 249b8ea2-8825-4ada-891c-72db3ea03581 is going to be updated. [ 1236.198978] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.199205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.199205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.199400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.199538] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.199703] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.603969] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1236.604212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.604398] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.604575] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.604764] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.604878] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.604945] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.605116] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.605200] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.605283] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.605372] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.678754] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.942284] env[62815]: INFO networking_nsxv3.common.synchronization [req-3fc69b0d-b339-41fd-819f-a084242b2990 req-d7cde018-620b-463d-9adf-2a80ed34e060 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1236.942828] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1236.943148] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.943272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.943340] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.943566] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.943730] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.943834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1236.943904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.944061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1236.944149] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1236.944239] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.108049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.108213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.108301] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.108950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.108950] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.108950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.109169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.109169] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.109232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.109328] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.109443] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.109548] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.109616] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.109713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.109879] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.109966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.110020] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.110147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.110220] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.110299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.110386] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.182518] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.182802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.182802] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.182960] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.183039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.183140] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d is going to be created. [ 1237.205240] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.205418] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.205484] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.205654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.205819] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.214109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: UNINITIALIZED for 2s [ 1237.446848] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.447083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.447139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.447444] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.447601] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.447822] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.447928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.447995] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.448168] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.448245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.448333] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1237.474369] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.474567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.474617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.474828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.474964] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.483351] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1237.614037] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 933a2727-d7f2-415f-9a38-6d105996267c: rpc.has_security_group_logging(os_id): False [ 1237.629958] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.630135] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.630212] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.630422] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.630529] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.630724] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.630822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.630886] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.631042] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.631120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.631313] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.631434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.631547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.631721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.631797] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.631989] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.632097] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.632159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.632297] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.632370] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.632453] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1237.694819] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.695131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1237.695131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.695267] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1237.695410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1237.730344] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1239.223520] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: SUCCESS [ 1239.223814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.223955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.224209] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.224397] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.224514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1239.224594] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.224748] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1239.224832] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.224918] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.225014] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.492917] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1239.492917] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 deletion is rescheduled due to dependency. [ 1239.492917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1239.728458] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.744180] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1239.744471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.230795] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d: rpc.has_security_group_logging(os_id): False [ 1240.248196] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.248353] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.248451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.248673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.248763] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.249023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.249122] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.249186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.249332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.249407] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.249492] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d is going to be created. [ 1240.306308] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.306461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1240.306518] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.306645] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1240.306817] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1240.315708] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: IN_PROGRESS for 2s [ 1241.943647] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.944040] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1242.327869] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: SUCCESS [ 1242.327869] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.581101] env[62815]: INFO networking_nsxv3.common.synchronization [req-26646e15-2c0f-498f-a003-2e66e1202ecf req-6d5b036b-2fd0-44ad-b1ee-2b79ea018aaa tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1246.581582] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1246.581896] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.582027] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.582098] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.582300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.582490] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.582573] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.582627] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.582736] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.582841] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.582934] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.884594] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-195 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.884861] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.884937] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.885229] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.885493] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.885659] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.885786] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.886070] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.886240] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.886490] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.886699] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.886900] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.887032] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.887162] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.887278] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.887417] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.907235] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.907405] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1246.907550] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.907723] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-195" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1246.908085] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-1b623109-bc26-4cd4-b63f-0b59173f1816 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.908264] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1246.908390] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.908711] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1246.908863] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b623109-bc26-4cd4-b63f-0b59173f1816',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.085422] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.085606] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.085686] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.086015] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.086131] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.086387] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.086544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.086626] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.086849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.086955] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.087085] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1247.111023] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.111222] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.111310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.111611] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.111781] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.120461] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1247.411652] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.412021] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.412207] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.412536] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.412726] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.412924] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Segment Port 1b623109-bc26-4cd4-b63f-0b59173f1816 not found, creating... [ 1247.413256] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.413494] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.413561] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.413851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.414012] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.414308] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.414469] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.414607] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.414832] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.414974] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.415297] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 1b623109-bc26-4cd4-b63f-0b59173f1816 is going to be created. [ 1247.447464] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.447692] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1247.447806] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.448094] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1247.448334] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1247.448564] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.111564] env[62815]: INFO networking_nsxv3.common.synchronization [req-26646e15-2c0f-498f-a003-2e66e1202ecf req-6070c091-f556-4b6d-9656-164122390ae2 service nova] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 1248.111889] env[62815]: INFO networking_nsxv3.common.synchronization [req-26646e15-2c0f-498f-a003-2e66e1202ecf req-6070c091-f556-4b6d-9656-164122390ae2 service nova] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1248.112028] env[62815]: INFO networking_nsxv3.common.synchronization [req-26646e15-2c0f-498f-a003-2e66e1202ecf req-6070c091-f556-4b6d-9656-164122390ae2 service nova] Enqueued Resource ID: 1b623109-bc26-4cd4-b63f-0b59173f1816 with Priority: HIGHEST for action port [ 1248.112529] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_rules [ 1248.112667] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1248.112793] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b623109-bc26-4cd4-b63f-0b59173f1816 with Priority: HIGHEST for action port [ 1248.113306] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.113465] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.113528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.113919] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.114157] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.115542] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.115542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.116189] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b623109-bc26-4cd4-b63f-0b59173f1816 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.116293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.116361] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.116636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.116792] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b623109-bc26-4cd4-b63f-0b59173f1816',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.616100] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.616319] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.618603] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b623109-bc26-4cd4-b63f-0b59173f1816 with status ACTIVE [ 1248.618818] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.618928] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.619083] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.619711] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.619840] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.620086] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.620231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.620231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.620350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.620436] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.620614] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.620713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.620770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.620904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.620977] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.621074] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b623109-bc26-4cd4-b63f-0b59173f1816 is going to be updated. [ 1248.641017] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.641232] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1248.641292] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.641531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1248.641714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1248.641875] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b623109-bc26-4cd4-b63f-0b59173f1816" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.129603] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1249.129981] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 deletion is rescheduled due to dependency. [ 1249.129981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.130078] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.130245] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.130421] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.130535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.130598] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.130747] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.130873] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.130930] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.287135] env[62815]: INFO networking_nsxv3.common.synchronization [req-3cfe3911-0750-4e91-a90d-667401f83710 req-ddf47452-cdb7-4d17-9ebf-554f9610899b tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1249.287657] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1249.287968] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.288112] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.288186] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.288379] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.288533] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.288633] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1249.288697] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.288844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1249.288935] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1249.289152] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.636412] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.790688] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.140712] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.293298] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.642877] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.642877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.642877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.642877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.642877] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.642877] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1250.677722] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.677970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.678067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.678344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.678543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.687845] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1250.795683] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.795923] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.796051] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.796365] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.796462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.796651] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be updated. [ 1250.823736] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.823893] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1250.823938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.824187] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1250.824332] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1250.832730] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: IN_PROGRESS for 2s [ 1252.241797] env[62815]: INFO networking_nsxv3.common.synchronization [req-a3f8f86a-bf2e-4423-9f8e-67ccdd229edd req-43801cb1-ab5b-40e2-be26-c6ad1e2a8d2d tempest-AttachVolumeNegativeTest-1372178925 tempest-AttachVolumeNegativeTest-1372178925-project-member] Enqueued Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_members [ 1252.242718] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b with Priority: HIGHEST for action security_group_members [ 1252.243208] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.243396] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.243519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.243856] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.244127] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.244761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.244761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.244761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.244761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.244973] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1fff72-edb0-4132-b12f-f8e30ff1c78b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.697027] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1252.697272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.697447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.697677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.697875] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.698094] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.698197] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.698363] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.698446] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.698535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.698671] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.748225] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.748447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.748447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.748672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.748769] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.748992] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.749134] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.749217] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.749382] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.749463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.749551] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b is going to be updated. [ 1252.777630] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.777870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1252.777870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.778117] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1252.778273] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1252.786592] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b in Status: IN_PROGRESS for 2s [ 1252.842516] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 1252.842723] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.201118] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.703205] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd01ddbc-d1e1-4701-8791-8347e2ae4ba7: rpc.has_security_group_logging(os_id): False [ 1253.724275] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.724457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.724507] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.724758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.724897] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.725197] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.725354] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.725427] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.725629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.725731] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.725845] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1253.784618] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.784859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1253.784859] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.785069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1253.785218] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1253.796945] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1254.795910] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b in Status: SUCCESS [ 1254.796320] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1fff72-edb0-4132-b12f-f8e30ff1c78b deletion is rescheduled due to dependency. [ 1254.796320] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1fff72-edb0-4132-b12f-f8e30ff1c78b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1255.810965] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1255.811300] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1257.244148] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.244472] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.245821] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.246244] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.485192] env[62815]: INFO networking_nsxv3.common.synchronization [req-c425a7fb-a92d-4960-a7ec-e955a3ea7e9b req-297852d4-6e85-482f-9553-4b369e3d036b tempest-ServerActionsTestOtherA-1201976250 tempest-ServerActionsTestOtherA-1201976250-project-member] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1265.485545] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGHEST for action security_group_members [ 1265.486162] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.486162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.486162] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.486770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.486983] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.487159] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.487260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.487462] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.487719] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.487719] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.994542] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.994542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.994542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.994542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.994542] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.994846] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.994950] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1265.995055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.995255] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1265.995344] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1265.995439] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be updated. [ 1266.027099] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.027278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1266.027278] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.027480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1266.027620] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1266.036961] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: IN_PROGRESS for 2s [ 1268.053915] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 in Status: SUCCESS [ 1268.054271] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 deletion is rescheduled due to dependency. [ 1268.054271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.061600] env[62815]: INFO networking_nsxv3.common.synchronization [req-68841b11-6e9c-478b-9e6e-d288d28e84c6 req-248fbf5f-7353-4b1b-954c-739e4bf6e34f tempest-DeleteServersTestJSON-1957485218 tempest-DeleteServersTestJSON-1957485218-project-member] Enqueued Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1269.062176] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 933a2727-d7f2-415f-9a38-6d105996267c with Priority: HIGHEST for action security_group_members [ 1269.062675] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-933a2727-d7f2-415f-9a38-6d105996267c taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.062675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.062675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.062913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.063015] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.063434] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.063501] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.063654] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.063749] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.063859] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('933a2727-d7f2-415f-9a38-6d105996267c',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.566477] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.566683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.566683] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.566906] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.567013] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.567210] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.567311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.567371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.567519] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.567595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.567680] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c is going to be updated. [ 1269.592067] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.592226] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1269.592272] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.592417] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1269.592547] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1269.601420] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: IN_PROGRESS for 2s [ 1271.611702] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 933a2727-d7f2-415f-9a38-6d105996267c in Status: SUCCESS [ 1271.612081] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 933a2727-d7f2-415f-9a38-6d105996267c deletion is rescheduled due to dependency. [ 1271.612081] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-933a2727-d7f2-415f-9a38-6d105996267c" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1274.062904] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.063328] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1279.064092] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.064419] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.426096] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.426096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1281.426096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.426096] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1281.426096] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.928463] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.431167] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.933672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1282.933672] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1283.778276] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.778673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.778673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.778673] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.791077] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1283.791904] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.792556] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1283.827443] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.827596] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.827672] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.827815] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.841120] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.841831] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1283.841910] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1283.841998] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1283.880105] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.880299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.880299] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.880496] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.881675] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.881847] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1283.955466] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.955637] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1283.955674] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.955846] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1283.956152] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1283.956415] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1284.030805] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.030958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.030958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.031174] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.031478] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.031777] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1284.031875] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c7acd52f-0ca6-446a-a4c8-68abd06e46eb', 'cc8ead0f-ce38-4f18-ae1d-b6c8d8602981', '57828e0d-c3cb-4556-9802-017ac3330eda', '798082d0-32b4-40be-bc6c-1997cce6f121', 'cd01ddbc-d1e1-4701-8791-8347e2ae4ba7', '850db9bd-9d54-4da0-9136-8492981ff313', '1fcafbe4-f0ad-4f19-b02b-271988c9904b', '1d6bbb76-6d82-445e-a124-2538b600ecb4', 'd0748a1f-4ae2-44e2-8ece-647fc8e0c23d', '96ccef0c-31fb-4177-add9-d374ddad2ddb', 'fff1e9e6-fc12-4fc6-91f0-37bb29ad92da', 'b8d730a4-9510-494a-a33d-86b82a27d766', 'a03c29c0-c680-419e-9d7c-4307d6fd5fd7', '660d9a55-7b14-45fd-8919-bb2ac822b971', '4881bfba-b46e-4d29-a2f7-9a11e08570b3', '686574a8-1080-450a-a759-40ce406709a1', 'da316b9b-b9bf-4447-82c9-6a5a9cd1d7df', '97bb76de-5dc3-4e83-aabb-986627b27731', '0a2c2367-6874-44cf-8d41-422278b8bbc7', 'c35be23b-c5a4-4440-8ddb-1a5f961d3c7d', 'd4eb0fce-410c-49a9-858d-6d903b2d7c99', '7db29840-7ccf-49ac-af49-fd6b13cfbba7', '6c580d0c-d242-4267-94c1-b84435b0f93c', '2a1fff72-edb0-4132-b12f-f8e30ff1c78b', 'e2f3140d-d06d-40e7-9719-ba1446ff3270', 'faad13ba-ac02-4335-855b-47b1737205ca', '6021d487-9de7-424f-8bb7-283b2180f7a7', '71609a59-7de6-462b-b6e5-244b95f4175c', '11303673-d09a-48d1-9cad-14317bc7650c', '50e0bba8-1a6b-4f2c-9c5f-52849e6b3b04', 'df11bad1-7d19-47ba-9b6a-8f12d59d5612', '21b0e5c1-1fe6-480e-963c-67f29a11cd78', '64b65322-480c-4891-a478-1d5f60cffcc2', 'e6596d0c-454d-48ce-b640-ed4a68bd5faa', '6cf19e4b-027b-4e5f-b7e7-c3f65de04c7d', '0a93e2c7-70fc-4898-bef6-476829a0870e', '0f996b59-23a9-402b-8f9c-3e070b4b44dd', '7b1e8494-19bd-43a5-bc77-e4439e6c5b2d', '41866433-86ed-4e96-8599-ed0cbfc87e32', '000b3eb1-9f29-4aa6-83f0-8d3b1d404ff7', 'e2840bf9-b592-4644-bcf1-bd4ca72a79e5', '3bbf8fa4-b4f6-4219-bacf-b7f0e3798ecd', 'b4d6d0cd-3c56-42cd-8d37-8158526e935b', 'efc2ed6b-2e8e-4063-a9b0-0d3cac1a166a', '50851b2f-e9ba-4c66-9351-f1d66386b1c2', 'bdd0df41-58d9-475d-b389-1f971293a516', '933a2727-d7f2-415f-9a38-6d105996267c', '95315c29-36f4-4fb3-afae-f96b062c5650'} {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1284.031992] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1284.058157] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.058311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.058371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.058563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.058642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.058746] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1284.058820] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1284.058892] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1284.065151] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.065236] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1284.134457] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.134605] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1284.134653] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.134858] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1284.136017] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1284.136282] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1284.136362] env[62815]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62815) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1284.136433] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1284.136501] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1284.136579] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1284.136651] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGH for action security_group_rules [ 1284.136746] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGH for action security_group_rules [ 1284.136815] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGH for action security_group_rules [ 1284.136881] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGH for action security_group_rules [ 1284.136945] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGH for action security_group_rules [ 1284.137014] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGH for action security_group_rules [ 1284.137083] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGH for action security_group_rules [ 1284.137142] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGH for action security_group_rules [ 1284.137206] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGH for action security_group_rules [ 1284.137269] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGH for action security_group_rules [ 1284.137331] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGH for action security_group_rules [ 1284.137392] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGH for action security_group_rules [ 1284.137495] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGH for action security_group_rules [ 1284.137539] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGH for action security_group_rules [ 1284.137564] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGH for action security_group_rules [ 1284.137626] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGH for action security_group_rules [ 1284.137688] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGH for action security_group_rules [ 1284.137750] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGH for action security_group_rules [ 1284.137812] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGH for action security_group_rules [ 1284.137876] env[62815]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGH for action security_group_rules [ 1284.137973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.066666] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.066993] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1289.066993] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb with Priority: HIGH for action security_group_rules [ 1289.067126] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57828e0d-c3cb-4556-9802-017ac3330eda with Priority: HIGH for action security_group_rules [ 1289.067126] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b with Priority: HIGH for action security_group_rules [ 1289.067230] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 with Priority: HIGH for action security_group_rules [ 1289.067327] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d with Priority: HIGH for action security_group_rules [ 1289.067421] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 with Priority: HIGH for action security_group_rules [ 1289.067516] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bb76de-5dc3-4e83-aabb-986627b27731 with Priority: HIGH for action security_group_rules [ 1289.067609] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df with Priority: HIGH for action security_group_rules [ 1289.067721] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 with Priority: HIGH for action security_group_rules [ 1289.067810] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686574a8-1080-450a-a759-40ce406709a1 with Priority: HIGH for action security_group_rules [ 1289.067897] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 with Priority: HIGH for action security_group_rules [ 1289.067951] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d730a4-9510-494a-a33d-86b82a27d766 with Priority: HIGH for action security_group_rules [ 1289.068052] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da with Priority: HIGH for action security_group_rules [ 1289.068142] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb with Priority: HIGH for action security_group_rules [ 1289.068241] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d with Priority: HIGH for action security_group_rules [ 1289.068357] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850db9bd-9d54-4da0-9136-8492981ff313 with Priority: HIGH for action security_group_rules [ 1289.068479] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 with Priority: HIGH for action security_group_rules [ 1289.068540] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGH for action security_group_rules [ 1289.068655] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 with Priority: HIGH for action security_group_rules [ 1289.068708] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 798082d0-32b4-40be-bc6c-1997cce6f121 with Priority: HIGH for action security_group_rules [ 1289.069060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.069195] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.069307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.069482] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.069562] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7acd52f-0ca6-446a-a4c8-68abd06e46eb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.070776] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57828e0d-c3cb-4556-9802-017ac3330eda taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.071369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.071369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.071369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.071369] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57828e0d-c3cb-4556-9802-017ac3330eda',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.071945] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.072071] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.072133] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.072271] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.072343] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fcafbe4-f0ad-4f19-b02b-271988c9904b',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.073036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.073147] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.073428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.073428] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.073428] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4881bfba-b46e-4d29-a2f7-9a11e08570b3',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.074161] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.074233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.074310] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.074433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.074504] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35be23b-c5a4-4440-8ddb-1a5f961d3c7d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.075380] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a2c2367-6874-44cf-8d41-422278b8bbc7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.075448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.075544] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.075664] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.075732] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a2c2367-6874-44cf-8d41-422278b8bbc7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.076411] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97bb76de-5dc3-4e83-aabb-986627b27731 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.076511] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.076567] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.076713] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.076786] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97bb76de-5dc3-4e83-aabb-986627b27731',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.077512] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.077628] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.077679] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.077826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.077896] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da316b9b-b9bf-4447-82c9-6a5a9cd1d7df',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.078667] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-660d9a55-7b14-45fd-8919-bb2ac822b971 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.078771] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.078872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.079154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.079250] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('660d9a55-7b14-45fd-8919-bb2ac822b971',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.080060] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-686574a8-1080-450a-a759-40ce406709a1 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.080199] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.080269] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.080449] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.080533] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('686574a8-1080-450a-a759-40ce406709a1',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.081268] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.081372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.081439] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.081590] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.081664] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03c29c0-c680-419e-9d7c-4307d6fd5fd7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.082497] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8d730a4-9510-494a-a33d-86b82a27d766 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.082613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.083141] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.083326] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.083406] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8d730a4-9510-494a-a33d-86b82a27d766',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.084101] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.084213] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.084270] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.084416] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.084623] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fff1e9e6-fc12-4fc6-91f0-37bb29ad92da',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.085278] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96ccef0c-31fb-4177-add9-d374ddad2ddb taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.085399] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.085467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.085634] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.085696] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96ccef0c-31fb-4177-add9-d374ddad2ddb',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.086370] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.086521] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.086577] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.086677] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.086735] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0748a1f-4ae2-44e2-8ece-647fc8e0c23d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.087423] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850db9bd-9d54-4da0-9136-8492981ff313 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.087522] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.087589] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.087800] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.087800] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850db9bd-9d54-4da0-9136-8492981ff313',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.088550] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d6bbb76-6d82-445e-a124-2538b600ecb4 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.088695] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.088734] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.088849] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.088919] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d6bbb76-6d82-445e-a124-2538b600ecb4',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.089609] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.089809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.089809] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.089913] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.089982] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.090657] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.090759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.090823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.091025] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.091129] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc8ead0f-ce38-4f18-ae1d-b6c8d8602981',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.091765] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-798082d0-32b4-40be-bc6c-1997cce6f121 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.091979] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.092236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.092236] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.092363] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('798082d0-32b4-40be-bc6c-1997cce6f121',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.114174] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.114291] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.114371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.114549] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.131123] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.131228] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fcafbe4-f0ad-4f19-b02b-271988c9904b is going to be deleted. [ 1289.178541] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.178724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.178724] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.178910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.179000] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.179125] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fcafbe4-f0ad-4f19-b02b-271988c9904b" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.594354] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.594509] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.594629] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.595171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.595171] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.595171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.595171] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.595350] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.595387] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.595453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.595536] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.672312] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.672460] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.672533] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.672751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.674726] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.674726] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.675516] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.675661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.676676] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.676762] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.679633] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.679761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.680614] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.680730] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.681465] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.681582] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.682400] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.682506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.683269] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.683333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.684049] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.684143] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.684861] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.685029] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.685601] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.686036] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.686136] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.686735] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.687149] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.687259] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.687911] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.688309] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.688410] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.689356] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.689849] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.690067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.690561] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.690938] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.691052] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.691778] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.692226] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.692333] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.692967] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.693385] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.693515] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.694116] env[62815]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.694506] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.694614] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850db9bd-9d54-4da0-9136-8492981ff313 is going to be deleted. [ 1289.695486] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.695689] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.713970] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.714109] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7acd52f-0ca6-446a-a4c8-68abd06e46eb is going to be deleted. [ 1289.714910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.715146] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.731372] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.731490] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97bb76de-5dc3-4e83-aabb-986627b27731 is going to be deleted. [ 1289.732352] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.732555] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.751066] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.751184] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4881bfba-b46e-4d29-a2f7-9a11e08570b3 is going to be deleted. [ 1289.751988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.752233] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.787656] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.787905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.794647] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.794760] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc8ead0f-ce38-4f18-ae1d-b6c8d8602981 is going to be deleted. [ 1289.795613] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.795827] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.797655] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.797764] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.801343] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.801447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.815757] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.815882] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 686574a8-1080-450a-a759-40ce406709a1 is going to be deleted. [ 1289.816811] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.817039] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.848779] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.848971] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.851183] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.851306] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da316b9b-b9bf-4447-82c9-6a5a9cd1d7df is going to be deleted. [ 1289.852231] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.852447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.908727] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.908988] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1289.913069] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.913212] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 660d9a55-7b14-45fd-8919-bb2ac822b971 is going to be deleted. [ 1289.914103] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.914314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1289.945986] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1289.946176] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35be23b-c5a4-4440-8ddb-1a5f961d3c7d is going to be deleted. [ 1289.947075] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.947295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.013304] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.013441] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fff1e9e6-fc12-4fc6-91f0-37bb29ad92da is going to be deleted. [ 1290.014395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.014610] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.016031] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.016161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.094901] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.095267] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57828e0d-c3cb-4556-9802-017ac3330eda is going to be deleted. [ 1290.096364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.096364] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.098217] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.098312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.110969] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.128510] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.128660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.132202] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.132339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.167838] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.168088] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a2c2367-6874-44cf-8d41-422278b8bbc7 is going to be deleted. [ 1290.169461] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.169787] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.171923] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.172067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.257471] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.257658] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03c29c0-c680-419e-9d7c-4307d6fd5fd7 is going to be deleted. [ 1290.258619] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.258855] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.306009] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.306178] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 798082d0-32b4-40be-bc6c-1997cce6f121 is going to be deleted. [ 1290.307061] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.307323] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.362894] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.363104] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.386050] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.386303] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.398393] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.398555] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d6bbb76-6d82-445e-a124-2538b600ecb4 is going to be deleted. [ 1290.399472] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.399694] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.415283] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.415447] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.416035] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.416161] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.464392] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.464537] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8d730a4-9510-494a-a33d-86b82a27d766 is going to be deleted. [ 1290.465706] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.465924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.501213] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.501366] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.546791] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.547020] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96ccef0c-31fb-4177-add9-d374ddad2ddb is going to be deleted. [ 1290.547981] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.548258] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.586062] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.586198] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0748a1f-4ae2-44e2-8ece-647fc8e0c23d is going to be deleted. [ 1290.587378] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.587660] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.587834] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.588074] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7acd52f-0ca6-446a-a4c8-68abd06e46eb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.588341] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.588595] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.588733] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.588947] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850db9bd-9d54-4da0-9136-8492981ff313" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.590371] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.590535] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.590655] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.590905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.591067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.591302] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8d730a4-9510-494a-a33d-86b82a27d766" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.591508] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.591768] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.591910] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.592126] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97bb76de-5dc3-4e83-aabb-986627b27731" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.592307] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.592525] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.592657] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.592844] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4881bfba-b46e-4d29-a2f7-9a11e08570b3" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.593119] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.593288] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.593463] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.593650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc8ead0f-ce38-4f18-ae1d-b6c8d8602981" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.593828] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.594369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.594369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.594369] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-686574a8-1080-450a-a759-40ce406709a1" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.594543] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.594804] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.594938] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.595156] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da316b9b-b9bf-4447-82c9-6a5a9cd1d7df" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.595359] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.595578] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.595714] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.595917] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-660d9a55-7b14-45fd-8919-bb2ac822b971" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.596158] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.596395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.596531] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.596721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35be23b-c5a4-4440-8ddb-1a5f961d3c7d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.596942] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.597194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.597330] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.597532] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fff1e9e6-fc12-4fc6-91f0-37bb29ad92da" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.597761] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.598055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.598198] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.598426] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a2c2367-6874-44cf-8d41-422278b8bbc7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.598635] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.598874] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.599035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.599260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57828e0d-c3cb-4556-9802-017ac3330eda" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.599456] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.599685] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.599822] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.600022] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03c29c0-c680-419e-9d7c-4307d6fd5fd7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.600216] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.600451] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.600593] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.600818] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-798082d0-32b4-40be-bc6c-1997cce6f121" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.601055] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.601312] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.601457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.601652] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d6bbb76-6d82-445e-a124-2538b600ecb4" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.613127] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd01ddbc-d1e1-4701-8791-8347e2ae4ba7: rpc.has_security_group_logging(os_id): False [ 1290.632734] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.632973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.632973] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.633157] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.656710] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.656958] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.657826] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.658121] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.658241] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.658295] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.658467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.658561] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.658648] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1290.659751] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.659930] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.660035] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.660194] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96ccef0c-31fb-4177-add9-d374ddad2ddb" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.664360] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.664500] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.664563] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.664758] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.664848] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.664966] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0748a1f-4ae2-44e2-8ece-647fc8e0c23d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.786132] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.786325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1290.786360] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.786607] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1290.786759] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1290.813435] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1292.831922] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1292.832293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1294.070204] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.070650] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1299.070861] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.071275] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.071500] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.071900] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.565340] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.565649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.565694] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.565948] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.566229] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.566395] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.566519] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.566745] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.566896] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.567161] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1308.567283] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] NeedRegenerationException {{(pid=62815) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1308.567397] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] no value, waiting for create lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1308.567510] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] value creation lock acquired {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1308.567623] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] No value present for key: 'zone-id' {{(pid=62815) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1308.567733] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Calling creation function for not-yet-present value {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1308.567870] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1308.586570] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1308.586725] env[62815]: DEBUG dogpile.cache.region [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62815) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1308.586865] env[62815]: DEBUG dogpile.lock [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Released creation lock {{(pid=62815) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1308.587046] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "network-414" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1308.587332] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock port-249b8ea2-8825-4ada-891c-72db3ea03581 taken with stack trace [, , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.587496] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1308.587619] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.587851] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1308.587986] env[62815]: DEBUG networking_nsxv3.api.rpc [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b8ea2-8825-4ada-891c-72db3ea03581',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.072620] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.072758] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1309.089821] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.090067] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.090205] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.090488] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.090649] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.090937] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.091114] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.091243] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.091473] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.091615] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.091896] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.092096] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.092233] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.092447] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.092588] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.092733] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Resource: SegmentPort with ID: 249b8ea2-8825-4ada-891c-72db3ea03581 is going to be updated. [ 1309.112322] env[62815]: DEBUG networking_nsxv3.common.locking [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.112510] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.112617] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.112845] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.113044] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.113259] env[62815]: DEBUG oslo_concurrency.lockutils [None req-97098404-9b6e-4df1-a6a7-efe35d9f31ab None None] Releasing lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.768640] env[62815]: INFO networking_nsxv3.common.synchronization [req-30203dc2-f557-4324-8c3d-e046758e2846 req-c7e413ee-76a8-4d6a-98b2-d9b1289848d3 service nova] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1309.768878] env[62815]: INFO networking_nsxv3.common.synchronization [req-30203dc2-f557-4324-8c3d-e046758e2846 req-c7e413ee-76a8-4d6a-98b2-d9b1289848d3 service nova] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1309.769012] env[62815]: INFO networking_nsxv3.common.synchronization [req-30203dc2-f557-4324-8c3d-e046758e2846 req-c7e413ee-76a8-4d6a-98b2-d9b1289848d3 service nova] Enqueued Resource ID: 249b8ea2-8825-4ada-891c-72db3ea03581 with Priority: HIGHEST for action port [ 1309.769233] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_rules [ 1309.769366] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1309.769464] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b8ea2-8825-4ada-891c-72db3ea03581 with Priority: HIGHEST for action port [ 1309.770033] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.770137] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.770205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.770404] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.770484] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.771663] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.771770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.771837] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.772050] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.772159] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.772252] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.772314] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.772453] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.772536] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1309.772647] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.773349] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock port-249b8ea2-8825-4ada-891c-72db3ea03581 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.773457] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1309.773642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.773642] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1309.773739] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b8ea2-8825-4ada-891c-72db3ea03581',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.276522] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.277534] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.277721] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.277823] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 249b8ea2-8825-4ada-891c-72db3ea03581 with status ACTIVE [ 1310.277985] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.278115] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.278175] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.278357] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.278433] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.278602] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.278698] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.278743] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.278894] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.278968] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.279156] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.279250] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.279311] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.279448] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.279539] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.279596] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 249b8ea2-8825-4ada-891c-72db3ea03581 is going to be updated. [ 1310.300286] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.300442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.300514] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.300688] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.300814] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.300956] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-249b8ea2-8825-4ada-891c-72db3ea03581" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.782039] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.948933] env[62815]: INFO networking_nsxv3.common.synchronization [req-77bc3c76-4732-467d-a40b-cc8d560eee42 req-d742f557-a6d1-48a0-83f3-6423afc8fbc9 tempest-ServerActionsTestJSON-637578689 tempest-ServerActionsTestJSON-637578689-project-member] Enqueued Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1310.949481] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 with Priority: HIGHEST for action security_group_members [ 1310.949788] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.950770] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.950868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.951208] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.951244] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.951351] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1310.951400] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.951552] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1310.951636] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1310.951734] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd01ddbc-d1e1-4701-8791-8347e2ae4ba7',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.284929] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.285101] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1311.285205] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.285395] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1311.285490] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1311.285586] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d is going to be updated. [ 1311.315698] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.315868] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1311.315924] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.316142] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1311.316284] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1311.326141] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: IN_PROGRESS for 2s [ 1311.454353] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.454545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1311.454592] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.454808] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1311.454905] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1311.455201] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.455325] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1311.455394] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.455565] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1311.455650] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1311.455745] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 is going to be updated. [ 1311.481371] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.481371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1311.481371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.481371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1311.481371] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1311.489316] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: IN_PROGRESS for 2s [ 1313.335611] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: SUCCESS [ 1313.336085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.336085] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.336339] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1313.336576] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.336737] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1313.336823] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.337041] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1313.337154] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.337235] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.337304] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.498610] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 in Status: SUCCESS [ 1313.498757] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd01ddbc-d1e1-4701-8791-8347e2ae4ba7 deletion is rescheduled due to dependency. [ 1313.498872] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd01ddbc-d1e1-4701-8791-8347e2ae4ba7" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1313.839747] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.342596] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d: rpc.has_security_group_logging(os_id): False [ 1314.360239] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.360467] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1314.360537] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.360753] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1314.378067] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1314.378394] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.378545] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1314.378638] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.378870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1314.379661] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1314.379661] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d is going to be updated. [ 1314.443230] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.443430] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1314.443480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.443681] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1314.443829] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1314.455251] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: IN_PROGRESS for 2s [ 1315.950906] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.950906] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1316.470057] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: SUCCESS [ 1316.470260] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1320.952541] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.952541] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.953847] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.954241] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.955282] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.955647] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.956740] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.957151] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.957834] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.958248] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.959066] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.959453] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.959961] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.960374] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.961650] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.962075] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.963412] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.963802] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.316884] env[62815]: INFO networking_nsxv3.common.synchronization [req-c940ae1f-bbe0-4c09-a603-e015138d55d0 req-92b93de7-e129-4c2f-9677-9edafadd3a2f tempest-AttachVolumeShelveTestJSON-1623834971 tempest-AttachVolumeShelveTestJSON-1623834971-project-member] Enqueued Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1361.317464] env[62815]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d with Priority: HIGHEST for action security_group_members [ 1361.317843] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d taken with stack trace [, , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.317974] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.318082] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.318425] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.318540] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.318617] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.318670] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.318773] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.318870] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.318982] env[62815]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b1e8494-19bd-43a5-bc77-e4439e6c5b2d',) {} {{(pid=62815) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.825065] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.825065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.825065] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.825348] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.825480] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.825759] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.825921] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.826046] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.826293] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.826442] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.826596] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d is going to be updated. [ 1361.855940] env[62815]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62815) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.856139] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 1361.856247] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.856528] env[62815]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 1361.856756] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1361.872247] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: IN_PROGRESS for 2s [ 1363.883249] env[62815]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d in Status: SUCCESS [ 1363.883587] env[62815]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b1e8494-19bd-43a5-bc77-e4439e6c5b2d deletion is rescheduled due to dependency. [ 1363.883587] env[62815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b1e8494-19bd-43a5-bc77-e4439e6c5b2d" {{(pid=62815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 1366.318832] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.319245] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.319951] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.320187] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.321620] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.321970] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.322724] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.322981] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.323569] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.323569] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.324797] env[62815]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.325122] env[62815]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0